Dataiku JEK port (Dataiku & Spark)
SangHoon
Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 15 ✭✭✭
Hello, I am using Dataiku 12.5.2 and Spark 3.2.2. I am utilizing PySpark in Dataiku. Upon checking the log, I see that it is initialized in the form of "Init: running in flow, JEK port=32929" from dku.spark.context. Is there a way to set the JEK port mentioned here to a fixed port or to allocate it within a specific range?
Operating system used: centos8
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,225 DataikerHi,
Setting to a single fixed port is not possible. It will need bidirectional communication on all ports (1025-65535).
There is no officially supported way to limit the range, but if you find this a blocker for you, please contact support or partner success manager.Thanks