Load from Oracle to Vertica

Options
AHerrera101499
AHerrera101499 Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 14

Hi everyone, How can I load data from an Oracle database to Vertica without drop the destiny table each time that I run the process? Because I try to use the sync recipe but each time that I run the flow, dataiku recreate the table in Vertica instead of append the new rows. I already try with the configurations of free schema and with append instead overwrite checkbox selected.

Tagged:

Best Answer

  • Sarina
    Sarina Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer Posts: 315 Dataiker
    Answer ✓
    Options

    Hi @AHerrera101499
    ,

    By default, all data will be written from the input dataset to the output dataset, and DSS will indeed clear the output dataset prior to writing to it. If you have "append mode" on, that should be sufficient, but I understand that it's not. Can you please attach a job diagnostic for the job while append mode is selected?

    If you wish to open a support ticket and attach the job diagnostic through the ticket instead, that's also fine.

    Thank you,
    Sarina

Answers

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,726 Neuron
    Options

    Note that using the append check box is not a guarantee that Dataiku will not drop the output table. For instance if the output data schema changes then Dataiku will need to recreate the table to match the new schema which means the table gets dropped and recreated. If you want full certainty Dataiku will not drop the table you will need to do the data insert in the output table manually (ie in a code recipe).

Setup Info
    Tags
      Help me…