Survey banner
The Dataiku Community is moving to a new home! We are temporary in read only mode: LEARN MORE

Does Schema propagation work on existing columns in a prepare recipe

NN
Does Schema propagation work on existing columns in a prepare recipe

Hi All,
I had a question on whether schema propagation works in the prepare recipe ? 

For if there is a column in the input dataset which has a datatype of BIGINIT then during the first run the output dataset will also have the datatype as BIGINT

But during a future run if the datatype of the column in the input dataset changes to DOUBLE , then this change doesnot propagate through to the output dataset. The column in the output dataset remains BIGINT and hence the values end up getting dropped.

Hence if anyone has any suggestions or has an idea if this has already been discussed in any other thread then please do guide me in the right direction.

0 Kudos
2 Replies
Turribeach

What Dataiku version are you on? There has been some fixes around schema propagation in v12:

https://doc.dataiku.com/dss/latest/release_notes/12.html#run-subsequent-recipes-and-on-the-fly-schem...

 

0 Kudos
NN
Author

Hi @Turribeach 
Yes i am on V12 . Tried this but somehow it doesnt work for the prepare recipe. 
If you believe it works at your end can you please let me know. 

0 Kudos