Many Recipe With One Output Folder

Options
tmgiang
tmgiang Registered Posts: 15 ✭✭✭✭
Can we export many recipe / dataset on flow to one folder?

I have many data set and I want to export all of them to one place, but dataiku seem does not allow to do that. Even I use Python code to do the export to local folder as working arround, but a recipe always need an output.
Tagged:

Best Answer

  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer Posts: 753 Dataiker
    Answer ✓
    Options
    Hi,

    You can "cheat" by having a recipe that does all exports but does not actually write to its output (the output is "dummy")

    The reason for that is the concept of the DSS Flow: in DSS you always "build" one output rather than "running" recipes. In order to build output, DSS recurses the dependencies graph to check for up-to-dateness. If there were two recipes writing in the same output, DSS wouldn't know which part of the dependency tree to use

Answers

Setup Info
    Tags
      Help me…