Community Conundrum 28: News Engagement is live! Read More

Scenario - Run spark-scala

Level 3
Scenario - Run spark-scala

Is it possible to run spark-scala notebook isolated form flow in scenario. 

I have a case of loading csv files from folder ( the folder updated every time) and would like to run the spark-scala in the scenario. 

0 Kudos
1 Reply
Dataiker
Dataiker

Hi,

This is not possible. We would advise you to create a "dummy" recipe in the Flow, that outputs into a dummy managed folder. You don't have to do anything with your output in the actual code, you just need an output that you can "build".

0 Kudos
A banner prompting to get Dataiku DSS