Scenario - Run spark-scala

Bader
Bader Registered Posts: 46 ✭✭✭✭✭
in Using Dataiku

Is it possible to run spark-scala notebook isolated form flow in scenario.

I have a case of loading csv files from folder ( the folder updated every time) and would like to run the spark-scala in the scenario.

· Share on FacebookShare on Twitter

Best Answer

  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer, Registered Posts: 753 Dataiker
    Answer ✓

    Hi,

    This is not possible. We would advise you to create a "dummy" recipe in the Flow, that outputs into a dummy managed folder. You don't have to do anything with your output in the actual code, you just need an output that you can "build".

    · Share on FacebookShare on Twitter
Bookmark this topic

Categories

Setup Info
    Tags
      Help me…