How to build the flow with schema changes done automatically
Hi Team,
I have a use case where I have changed the schema of the dataset A. Dataset A is having 3 rows and I have added 1 more column and I want to build these schema changes to all the following datasets automatically rather running each recipe manually and then clicking on update schema. Is there any way we can do this ?
Regards,
Tejasri.
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,212 Dataiker
Hi @Tsurapaneni
,You can use the Schema propagation feature.
Which also has the option to perform all changes automatically.
-
FYI, we have just released improvements to schema propagation & building behavior in V12. You can now run downstream & propagate schema from the "run" button within a recipe, or from the flow's "build" button.
See more detail in our reference docs & knowledge base article.
Let me know if you have any questions!
Katie