Upsert of daily data in Dataiku DSS
yasmine
Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 14 ✭✭✭✭
I work on data fed daily and I try to find a way in Dataiku to do upsert: do at the same time update records and insert new records, what are the different ways to do this please?
Answers
-
Manuel Alpha Tester, Dataiker Alumni, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Dataiku DSS Adv Designer, Registered Posts: 193 ✭✭✭✭✭✭✭Hi,
I recommend that you have a look at the partitioning functionality, which allows you to process your dataset in specific chunks, for example your "daily feed":
- Introduction video,
//play.vidyard.com/w7ozrFT3REzedHvv6hKriJ.html?
- Academy course, https://academy.dataiku.com/advanced-partitioning
I hope this helps.
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,425 NeuronThere is a new Upsert recipe plugin available in 13.5.0:
However the documentation seems missing:
https://www.dataiku.com/product/plugins/upsert-recipe
