loading data from Redshift to Postgre SQL

Options
pphanireddy007
pphanireddy007 Registered Posts: 3

Hi All,

I have table in Redshift with columns A,B,C and I want to add this table data to another table in Postgre SQL without deleting records in postgresql.

Is it possible in Dataiku.

Example-

Redshift Table

employee Table with Columns A,B,C

Postgresql Table

Employee table with columns X,Y,Z

I want to add A column values to X ,B to Y and C to Z

I have only redshift connection in dataiku.

Answers

  • Alexandru
    Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,209 Dataiker
    Options

    Hi,
    You will likely need to use code to achieve this. By default, DSS will drop the table if you are to sync from Redshift to Postgres. You can opt to perform append on the output; this would work if the schema matches between Redshift and postgres table. This doesn't appear to be the case here.

    An option is to handle the inserts using SQLExecutor2 ( see page 23)
    https://pages.dataiku.com/hubfs/Interfacing%20with%20SQL%20in%20Python.pdf
    Thanks

Setup Info
    Tags
      Help me…