DSS Spark Streaming application support

Options
prabusrajan
prabusrajan Registered Posts: 1 ✭✭✭✭

I am looking to run a spark streaming application on DataIku, can someone provide me the necessary pointers to achieve it.

Answers

  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer Posts: 753 Dataiker
    Options

    Hi

    Dataiku does not have any specific support for Spark-streaming, nor a concept of "continually running activity".

    You may have some success by just using a regular Scala-spark recipe and writing your Scala Spark-streaming in it, making a recipe that essentially never completes, but your mileage may vary.

Setup Info
    Tags
      Help me…