Community Conundrum 25:Feature Visualization is now live! Read More

DSS Spark Streaming application support

Level 1
DSS Spark Streaming application support

I am looking to run a spark streaming application on DataIku, can someone provide me the necessary pointers to achieve it.

0 Kudos
1 Reply
Dataiker
Dataiker

Hi

Dataiku does not have any specific support for Spark-streaming, nor a concept of "continually running activity".

You may have some success by just using a regular Scala-spark recipe and writing your Scala Spark-streaming in it, making a recipe that essentially never completes, but your mileage may vary.

0 Kudos