Dataiku kafka connection
hi i want kafka connection from dataiku
administration -> connections -> new connections -> kafka select
I have configured NEW CONNECTION NAME and BOOSTRAP SERVERS according to the installed Kafka. However, I encountered the following error: "Connection to Kafka failed: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: listTopics, caused by: TimeoutException: Timed out waiting for a node assignment. Call: listTopics." I am using DATAIKU version 12.4.2 and Kafka version 2.6. The firewall is disabled between the server where DATAIKU is installed and the server where Kafka is installed, allowing TCP communication. Kafka is installed by default, so there are no custom property settings.
Operating system used: linux
Answers
-
Sarina Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 317 DataikerHi @sangkim
,
It appears that the Bootstrap servers setting in your connection is blank, is that correct? Can you clarify what value(s) you tried as the Bootstrap server, and where you determined this configuration in your Kafka settings? Usually it would be something like <host>:9093.
Thank you!
Sarina -
Hi @SangHoon were you able to solve this issue? I am facing a similar issue in Dataiku while trying to connect with a Kafka cluster.
Firewall between Kafka cluster and DSS server is open, we are using a JAAS Config but we are met with the same error over and over again.
"Connection to Kafka failed: org.apache.kafka.common.errors.TimeoutException: Timed out waiting for a node assignment. Call: listTopics, caused by: TimeoutException: Timed out waiting for a node assignment. Call: listTopics
"
