delete vs drop

Shahbaz

Hi, currently I am working on a project which I have to collect data but it should be new and have the same schema with previous one but without keeping the past data how can I do this?
Firstly, I thought that delete option will work for me but at the end, it didn't do what I am looking for;
Thanks in advance

Operating system used: windows

Operating system used: windows

Turribeach

I am not really sure what you are asking here. Dataiku loads new data and doesn't keep historical data by default, you don't have to do anything special to load new data. In fact for every recipe output that's stored in a SQL database Dataiku will issue a drop statement before loading the data (unless the Append instead of overwrite option is selected).

Shahbaz

I am asking that how may I keep the schema of a table but at the same time I want to delete inside of a table (by keeping its schema as I said)

Turribeach

Why do you need to keep the schema? By default Dataiku manages the schema because if you bring new columns or remove columns Dataiku will be able to push schema changes. It’s possible to manage the schema yourself but you will need to use a code recipe.

Shahbaz

I did, thanks. I have done this with sql code recipe

Shahbaz

Turribeach

Nov 25, 2024

Why do you need to keep the schema? By default Dataiku manages the schema because if you bring new columns or remove columns Dataiku will be able to push schema changes. It’s possible to manage the schema yourself but you will need to use a code recipe.

this is because in python recipe you are not able to append data to a table without schema