The February release for the Community is live! Read More

Reading dataset in Python recipe is very slow

beatrix_lin
Level 1
Reading dataset in Python recipe is very slow
I was using the following lines to read dataset into pandas dataframe

data=dataiku.Dataset('dataset name')

df_data=data.get_dataframe()

it takes almost 3 mins to read in the table. Alternatively if I export the dataset into csv and read in the csv it only takes 12s. I was wondering if there a more efficient way to read the dataset as panda dataframe without creating the intermediate csv file?

Thanks,
0 Kudos
1 Reply
Clément_Stenac
Dataiker
Dataiker
Hi,

How long does it take to export the dataset into CSV?
0 Kudos
Labels (1)
A banner prompting to get Dataiku DSS