DSS Spark Streaming application support

prabusrajan
prabusrajan Registered Posts: 1 ✭✭✭✭
in General Discussion

I am looking to run a spark streaming application on DataIku, can someone provide me the necessary pointers to achieve it.

· Share on FacebookShare on Twitter

Answers

  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer, Registered Posts: 753 Dataiker

    Hi

    Dataiku does not have any specific support for Spark-streaming, nor a concept of "continually running activity".

    You may have some success by just using a regular Scala-spark recipe and writing your Scala Spark-streaming in it, making a recipe that essentially never completes, but your mileage may vary.

    · Share on FacebookShare on Twitter
Bookmark this topic

Categories

Setup Info
    Tags
      Help me…