Scenario - Run spark-scala
Bader
Registered Posts: 46 ✭✭✭✭✭
Is it possible to run spark-scala notebook isolated form flow in scenario.
I have a case of loading csv files from folder ( the folder updated every time) and would like to run the spark-scala in the scenario.
Best Answer
-
Hi,
This is not possible. We would advise you to create a "dummy" recipe in the Flow, that outputs into a dummy managed folder. You don't have to do anything with your output in the actual code, you just need an output that you can "build".