Support PyArrow for dataiku.Dataset.get_dataframe
importthepandas
Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 115 Neuron
Currently, dataiku streams via java for most inputs. If possible, it would be great to support PyArrow if the dataiku.Dataset is found to be e.g. a parquet file to potentially speed up this operation greatly.
Tagged: