Many Recipe With One Output Folder
Options
tmgiang
Registered Posts: 15 ✭✭✭✭
Can we export many recipe / dataset on flow to one folder?
I have many data set and I want to export all of them to one place, but dataiku seem does not allow to do that. Even I use Python code to do the export to local folder as working arround, but a recipe always need an output.
I have many data set and I want to export all of them to one place, but dataiku seem does not allow to do that. Even I use Python code to do the export to local folder as working arround, but a recipe always need an output.
Tagged:
Best Answer
-
Hi,
You can "cheat" by having a recipe that does all exports but does not actually write to its output (the output is "dummy")
The reason for that is the concept of the DSS Flow: in DSS you always "build" one output rather than "running" recipes. In order to build output, DSS recurses the dependencies graph to check for up-to-dateness. If there were two recipes writing in the same output, DSS wouldn't know which part of the dependency tree to use
Answers
-
Thanks. That also my current solution
But I think DSS can custom "managed folder" to do that