Community Conundrums are live! Learn more

Scenario - Run spark-scala

Level 1
Scenario - Run spark-scala
Jump to solution

Is it possible to run spark-scala notebook isolated form flow in scenario. 

I have a case of loading csv files from folder ( the folder updated every time) and would like to run the spark-scala in the scenario. 

0 Kudos
1 Reply
Dataiker
Dataiker

Hi,

This is not possible. We would advise you to create a "dummy" recipe in the Flow, that outputs into a dummy managed folder. You don't have to do anything with your output in the actual code, you just need an output that you can "build".

0 Kudos