How to build the flow with schema changes done automatically

Tsurapaneni
Level 3
How to build the flow with schema changes done automatically

Hi Team, 

I have a use case where I have changed the schema of the dataset A. Dataset A is having 3 rows and I have added 1 more column and I want to build these schema changes to all the following datasets automatically rather running each recipe manually and then clicking on update schema. Is there any way we can do this ?

Regards,

Tejasri.

0 Kudos
2 Replies
AlexT
Dataiker

Hi @Tsurapaneni ,

You can use the Schema propagation feature. 

https://knowledge.dataiku.com/latest/courses/flow-views-and-actions/schema-propagation-concept-summa...

Which also has the option to perform all changes automatically.

Screenshot 2021-11-29 at 19.00.35.png

 

0 Kudos
ktgross15
Dataiker

@Tsurapaneni ,

FYI, we have just released improvements to schema propagation & building behavior in V12. You can now run downstream & propagate schema from the "run" button within a recipe, or from the flow's "build" button.

See more detail in our reference docs & knowledge base article.

Let me know if you have any questions!

Katie

0 Kudos