Column count dropping in dataiku
I have one dataset where I have 11 columns, then in the preparation recipe one extra column is created and then immediately in the next dataset the column count drops to 7. How come is this possible?
The first dataset
The preparation recipe
The third dataset
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,501 NeuronCan you show a picture of the flow? Did you succesfully run the Prepare recipe? In the output dataset ⇒ Settings ⇒ Advanced check whether Table creation mode is set to "Automatically generate" and that "Prevent data drop in append mode" is unchecked under SQL schema inconsistency.
PS: I presume you mean the second dataset, not third. Or is there another dataset in the middle?
-
This is the picture of the flow:
-
I am unable to find any such options in the advanced settings in the output dataset:
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,501 Neuron
OK you are using an Azure Blob connection so it won't have the SQL options. Did you run the Prepare recipe? You need to run the recipe successfully for it to rebuild the output dataset and update it's sample. You can check the last build status on the dataset right pane, under the i section:
