How to reduce the time it takes to upload to TableauServer

Yusuke
Yusuke Partner, Registered Posts: 10 Partner

I uploaded data to TableauServer and it took about 8 hours. (This is about 200 million rows and 40 columns of data)
I ran it using the TableauHyperFormat plugin (https://www.dataiku.com/product/plugins/tableau-hyper-export/), and the logs show that I read 5000 rows into DF each, and 2000 rows each The logs appear to be reading 5,000 rows into the DF and executing writes of 2,000 rows each.

Is it possible to edit the parameters of the plugin to increase the upload speed by editing the amount of data written at a time?

Also, any other ideas on how to speed up the upload?

Thank you in advance.

Answers

Setup Info
    Tags
      Help me…