Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
delete vs drop
Added on November 23, 2024 6:44AM
Likes: 0
Replies: 5
Shahbaz
Registered Posts: 8 ✭✭
Hi, currently I am working on a project which I have to collect data but it should be new and have the same schema with previous one but without keeping the past data how can I do this?
Firstly, I thought that delete option will work for me but at the end, it didn't do what I am looking for;
Thanks in advance
Operating system used: windows
Operating system used: windows
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,394 NeuronI am not really sure what you are asking here. Dataiku loads new data and doesn't keep historical data by default, you don't have to do anything special to load new data. In fact for every recipe output that's stored in a SQL database Dataiku will issue a drop statement before loading the data (unless the Append instead of overwrite option is selected).
-
I am asking that how may I keep the schema of a table but at the same time I want to delete inside of a table (by keeping its schema as I said)
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,394 Neuron
Why do you need to keep the schema? By default Dataiku manages the schema because if you bring new columns or remove columns Dataiku will be able to push schema changes. It’s possible to manage the schema yourself but you will need to use a code recipe.
-
I did, thanks. I have done this with sql code recipe
-
this is because in python recipe you are not able to append data to a table without schema