Submit your innovative use case or inspiring success story to the 2023 Dataiku Frontrunner Awards! LET'S GO

DSS Spark Streaming application support

prabusrajan
Level 1
DSS Spark Streaming application support

I am looking to run a spark streaming application on DataIku, can someone provide me the necessary pointers to achieve it.

1 Reply
Clément_Stenac
Dataiker

Hi

Dataiku does not have any specific support for Spark-streaming, nor a concept of "continually running activity".

You may have some success by just using a regular Scala-spark recipe and writing your Scala Spark-streaming in it, making a recipe that essentially never completes, but your mileage may vary.

0 Kudos