Write huge data to Postgres efficiently
Hi, I'm a data engineer and working for walmart labs. my team is using dataiku to create flows and for creating a data lake and analysis. In one scenario we're writing huge data from a HDFS DSS down to postgres table. The process is taking a lot of time. I have checked this is because the insertion is happening…