Is there a way to propagate schema changes in a whole flow?

Alex_Reutter
Alex_Reutter Alpha Tester, Dataiker Alumni, Dataiku DSS Core Designer Posts: 105 ✭✭✭✭✭✭✭
When changes occur to the schema of a dataset early in a flow, you would like to be able to ensure that these changes are reflected in datasets further down the flow.
Tagged:

Answers

  • Alex_Reutter
    Alex_Reutter Alpha Tester, Dataiker Alumni, Dataiku DSS Core Designer Posts: 105 ✭✭✭✭✭✭✭
    Right click on the first dataset, click "Check schema from here", and then fix issues one by one. You'll have to rebuild some intermediate datasets as you progress through the flow.
  • Katie
    Katie Dataiker, Registered, Product Ideas Manager Posts: 110 Dataiker

    For any future readers of this post, note that we have just released improvements to schema propagation & building behavior in V12! You can now run downstream & propagate schema from the "run" button within a recipe, or from the flow's "build" button.

    See more detail in our reference docs & knowledge base article.

    Katie

Setup Info
    Tags
      Help me…