Problem with loading large files
Andres Santiago
Registered Posts: 1 ✭
I try to upload datasets from my location to dataiku but it only allows me to upload data smaller than 1 GB in weight. I have tried several types but it has not been possible since it generates an error when loading the information. I don't know if this is directly due to the instance or the license I have.
Tagged:
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,161 NeuronWe upload files bigger than 1GB all the time. What kind of Dataiku instance do you use?
-
Marlan Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Dataiku Frontrunner Awards 2021 Participant, Neuron 2023 Posts: 321 NeuronWe did run into issues uploading mult-GB files to a folder. Zipping the file can help. Dataiku can create datasets directly from the zipped file.
See this post for background on our experience:
Marlan
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,161 Neuron
"There is no theoretical size limitation for uploading files to DSS."