I was using the following lines to read dataset into pandas dataframe
data=dataiku.Dataset('dataset name')
df_data=data.get_dataframe()
it takes almost 3 mins to read in the table. Alternatively if I export the dataset into csv and read in the csv it only takes 12s. I was wondering if there a more efficient way to read the dataset as panda dataframe without creating the intermediate csv file?
Thanks,