This website uses cookies. By clicking OK, you consent to the use of cookies. Click Here to learn more about how we use cookies.
OK
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 
Check out Building a Data-Centric Culture at the ALMA Observatory on November 5th Read More

Reading dataset in Python recipe is very slow

beatrix_lin
Level 1
‎07-03-2019 10:21 PM
Reading dataset in Python recipe is very slow
I was using the following lines to read dataset into pandas dataframe

data=dataiku.Dataset('dataset name')

df_data=data.get_dataframe()

it takes almost 3 mins to read in the table. Alternatively if I export the dataset into csv and read in the csv it only takes 12s. I was wondering if there a more efficient way to read the dataset as panda dataframe without creating the intermediate csv file?

Thanks,
0 Kudos
Reply
1 Reply
Clément_Stenac
Dataiker
Dataiker
‎07-03-2019 10:22 PM
Hi,

How long does it take to export the dataset into CSV?
0 Kudos
Reply