loading data from Redshift to Postgre SQL

pphanireddy007
Level 1
loading data from Redshift to Postgre SQL

Hi All,

I have table in Redshift with columns A,B,C and I want to add this table data to another table in Postgre SQL without deleting records in postgresql.

Is it possible in Dataiku.

Example-

Redshift Table

employee Table with Columns A,B,C

Postgresql Table

Employee table with columns X,Y,Z

I want to add A column values to X ,B to Y and C to Z

I have only redshift connection in dataiku.

 

0 Kudos
1 Reply
AlexT
Dataiker

Hi,
You will likely need to use code to achieve this. By default, DSS will drop the table if you are to sync from Redshift to Postgres. You can opt to perform append on the output; this would work if the schema matches between Redshift and postgres table. This doesn't appear to be the case here.

An option is to handle the inserts using SQLExecutor2 ( see page 23)
https://pages.dataiku.com/hubfs/Interfacing%20with%20SQL%20in%20Python.pdf
Thanks

 

0 Kudos