UPSERT Sample or statement

Hi,
I'm new in Dataiku, I hv 1 new project to perform in dataiku which need to do upsert for existing table or dataset. May I know how can I perform the insert/update statment in SQL? Especially on input value from dataset? Let say I have abc dataset with 10 column data, but need to insert/update only 5 from 10 column? How to declare this data in insert statement?
Thanks in advance
Operating system used: windows
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,461 Neuron
Dataiku is not an ETL tool. While it can do some ETL it certainly not designed to replace one. You can read this thread to understand some of the issues you are going to find trying to do what you want using the visual flow. It will be best if you do your ETL upstream and then bring the data to Dataiku for machine learning modelling. Failing that you can write Python code to do anything you can ever want but again it won't be the most efficient way of doing ETL.
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,461 Neuron
There is a new Upsert recipe plugin available in 13.5.0:
DSS 13 Release notes — Dataiku DSS 13 documentationHowever the documentation seems missing:
https://www.dataiku.com/product/plugins/upsert-recipe
-
tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,622 Neuron
Tried to install this. At this time it does not seem to be available. I'm getting a 404 on the plugin page.
However, this will be very useful to us. -
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,461 Neuron
Hi Tom, I was able to install the plugin from the Plugins screen in my instance. What seems to be missing is the plugin documentation. Attached is the plugin if you want to install it manually.
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,461 Neuron
The plugin documentation page has been updated: