How to ingnore the Identity Column of SQL Server table in Dataiku
I have the SQL Server datasets as below
TableSource has 2 columns [Name] string, [Address] string from connection 1
TableDest has 3 columns [Id] int identity, [Name], [Address] from connection 2
How to import data from TableSource to TableDest on Dataiku?
Note: the connection1 and connection2 are on different SQL servers.
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,160 NeuronUse the Sync recipe to move the data from connection 1 to connection 2. Make sure you select the output on the second connection when you set the recipe.
-
The Sync recipe is trying in insert data to column Id as well. It's causing error "An explicit value for the identity column in table 'TableDest' can only be specified when a column list is used and IDENTITY_INSERT is ON."
I don't know how to ignore the Id column on Dataiku. -
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,160 Neuron
Use a Prepare recipe first to get rid of the column.
-
Please note that the Id column is in the input dataset, it's not in the output dataset.
-
Sorry for my typo. The Id column in the output dataset, not in the input dataset.