Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Hello,
I was wondering what is used by the get_dataframe() method in order to load the dataset into a pandas dataframe. If pandas is used, is it possible to pass an argument such as engine = "pyarrow" to speed up the loading process?
Thank you in advance!
Operating system used: Windows 10
Hi @DK ,
This is not currently possible but has been requested here: https://community.dataiku.com/t5/Product-Ideas/Support-PyArrow-for-dataiku-Dataset-get-dataframe/idi...
Feel free to upvote the existing product idea.
Thanks!