Fill in gaps - incremental load

raf_sia

We have requirement which requires full historical data, however we are using incremental load, is there any recipe for this action?

Turribeach

All recipes support the "Append instead of overwrite" option which is usually in the recipe's Input/Output tab but might be elsewhere in some recipes. Be careful with this option though, it does not guarantee that Dataiku will not drop the historical table if the schema changes which is how Dataiku will push schema changes. So in general you will be best to do your incremental load in Dataiku and then push those rows to the historical table outside of Dataiku so you can have full control of your historical table. With power comes responsability so you will need to manage your historical table accordingly (ie what to do with new columns are added, etc).

AHerrera101499

Hi @raf_sia
,Do you solve this situation?