How to ingnore the Identity Column of SQL Server table in Dataiku

Options
kevinhoang84
kevinhoang84 Registered Posts: 7

I have the SQL Server datasets as below
TableSource has 2 columns [Name] string, [Address] string from connection 1
TableDest has 3 columns [Id] int identity, [Name], [Address] from connection 2
How to import data from TableSource to TableDest on Dataiku?

Note: the connection1 and connection2 are on different SQL servers.

Tagged:

Answers

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,724 Neuron
    Options

    Use the Sync recipe to move the data from connection 1 to connection 2. Make sure you select the output on the second connection when you set the recipe.

  • kevinhoang84
    kevinhoang84 Registered Posts: 7
    Options

    The Sync recipe is trying in insert data to column Id as well. It's causing error "An explicit value for the identity column in table 'TableDest' can only be specified when a column list is used and IDENTITY_INSERT is ON."
    I don't know how to ignore the Id column on Dataiku.

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,724 Neuron
    Options

    Use a Prepare recipe first to get rid of the column.

  • kevinhoang84
    kevinhoang84 Registered Posts: 7
    Options

    Please note that the Id column is in the input dataset, it's not in the output dataset.

  • kevinhoang84
    kevinhoang84 Registered Posts: 7
    Options

    Sorry for my typo. The Id column in the output dataset, not in the input dataset.

Setup Info
    Tags
      Help me…