dataiky.Dataset.get_dataframe() with pyarrow

DK

Hello,

I was wondering what is used by the get_dataframe() method in order to load the dataset into a pandas dataframe. If pandas is used, is it possible to pass an argument such as engine = "pyarrow" to speed up the loading process?

Thank you in advance!

---

Operating system used: Windows 10

Alexandru

Hi @DK
,

This is not currently possible but has been requested here: https://community.dataiku.com/t5/Product-Ideas/Support-PyArrow-for-dataiku-Dataset-get-dataframe/idi-p/33381
Feel free to upvote the existing product idea.

Thanks!