Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
I am looking to run a spark streaming application on DataIku, can someone provide me the necessary pointers to achieve it.
Hi
Dataiku does not have any specific support for Spark-streaming, nor a concept of "continually running activity".
You may have some success by just using a regular Scala-spark recipe and writing your Scala Spark-streaming in it, making a recipe that essentially never completes, but your mileage may vary.