Survey banner
The Dataiku Community is moving to a new home! We are temporary in read only mode: LEARN MORE

Dataiku JEK port (Dataiku & Spark)

sangkim
Level 2
Dataiku JEK port (Dataiku & Spark)

Hello, I am using Dataiku 12.5.2 and Spark 3.2.2. I am utilizing PySpark in Dataiku. Upon checking the log, I see that it is initialized in the form of "Init: running in flow, JEK port=32929" from dku.spark.context. Is there a way to set the JEK port mentioned here to a fixed port or to allocate it within a specific range?

dasdsad.png

 


Operating system used: centos8

0 Kudos
1 Reply
AlexT
Dataiker

Hi,
Setting to a single fixed port is not possible. It will need bidirectional communication on all ports (1025-65535). 
There is no officially supported way to limit the range, but if you find this a blocker for you, please contact support or partner success manager.

Thanks 

0 Kudos