Which ports must be open between DSS and the Hadoop cluster?

UserBird

jrouquie

If you're using the Cloudera distribution, see

• http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_ig_ports_cm.html
• http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cdh_ig_ports_cdh5.html
• http://www.cloudera.com/content/cloudera/en/documentation/core/latest/topics/cm_ig_ports_impala.html

At least those ports should be open:

• 8020, 8022, 50470 and 50070,
• for HDFS: 50010, 1004, 50075, 8022, 50090, 50495,
• for Yarn: 8021, 8023, 50030, 50060, 8032, 8030, 8031, 8033, 8088, 8090, 8040, 8041, 8042 and maybe others,
• for Hive: 9083 and 10000,
• for Zookeeper: 2181,
• for Impala: 21050.

For other distributions, please refer to their respective documentation.