Connect the same folder to different recipes
Options
PapaA
Registered Posts: 20 ✭✭✭✭
Hi
do you know how can I connect a folder as an output for several recipes in the flow?
If I select a folder for a recipe, DSS does not allow me to link this folder for another recipe in the flow
Tagged:
Best Answer
-
Hi,
Indeed that pattern is not possible. This is by design to avoid conflicts/concurrency issues when writing from different recipes to the same output.
In DSS 7.0 (new!) we have released a new recipe to "Merge folders": https://doc.dataiku.com/dss/latest/release_notes/7.0.html#merge-folders-recipe
This way you could have different recipes writing to different output folders, and then a Merge folder recipe to merge all folders to a new one.
Hope it helps,
Alex
Answers
-
Thanks Alex - it sounds a bit complicated from a user perspective, however it will do the trick.