How to apply a workflow to several files

tjh Registered Posts: 20 ✭✭✭✭

Please see the workflow above. I would like to apply the lower part of the workflow, that is currently applied only to one file, to all files in a directory, and then concatenate all results. How can I do this with dataiku?



  • cperdigou
    cperdigou Alpha Tester, Dataiker Alumni Posts: 115 ✭✭✭✭✭✭✭

    Summing up above discussion:

    • You can only deploy models (and the accompanying analysis script) to an API node. This seems to be what you want.
    • To deploy in production a whole flow, you need to use an automation node.
    • This enables automatic rebuilding of the flow, including only on latest data.

    All these features are part of the enterprise edition only.

Setup Info
      Help me…