New to Dataiku DSS? Try out our NEW Quick Start Programs today and get onboarded on the product in just one hour! Let's go

Reading dataset in Python recipe is very slow

beatrix_lin
Level 1
Reading dataset in Python recipe is very slow
I was using the following lines to read dataset into pandas dataframe

data=dataiku.Dataset('dataset name')

df_data=data.get_dataframe()

it takes almost 3 mins to read in the table. Alternatively if I export the dataset into csv and read in the csv it only takes 12s. I was wondering if there a more efficient way to read the dataset as panda dataframe without creating the intermediate csv file?

Thanks,
0 Kudos
1 Reply
Clément_Stenac
Dataiker
Dataiker
Hi,

How long does it take to export the dataset into CSV?
0 Kudos
Labels (1)
A banner prompting to get Dataiku DSS