Check out Building a Data-Centric Culture at the ALMA Observatory on November 5th Read More

Reading dataset in Python recipe is very slow

Level 1
Reading dataset in Python recipe is very slow
I was using the following lines to read dataset into pandas dataframe

data=dataiku.Dataset('dataset name')

df_data=data.get_dataframe()

it takes almost 3 mins to read in the table. Alternatively if I export the dataset into csv and read in the csv it only takes 12s. I was wondering if there a more efficient way to read the dataset as panda dataframe without creating the intermediate csv file?

Thanks,
0 Kudos
1 Reply
Dataiker
Dataiker
Hi,

How long does it take to export the dataset into CSV?
0 Kudos