We're excited to announce that we're launching the second installment of Dataiku Product Days Register Now

DSS Spark Streaming application support

prabusrajan
Level 1
DSS Spark Streaming application support

I am looking to run a spark streaming application on DataIku, can someone provide me the necessary pointers to achieve it.

1 Reply
Clément_Stenac
Dataiker
Dataiker

Hi

Dataiku does not have any specific support for Spark-streaming, nor a concept of "continually running activity".

You may have some success by just using a regular Scala-spark recipe and writing your Scala Spark-streaming in it, making a recipe that essentially never completes, but your mileage may vary.

0 Kudos
A banner prompting to get Dataiku DSS