Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Problem with loading large files
Added on September 9, 2024 6:01PM
Likes: 0
Replies: 3
Andres Santiago
Registered Posts: 1 ✭
I try to upload datasets from my location to dataiku but it only allows me to upload data smaller than 1 GB in weight. I have tried several types but it has not been possible since it generates an error when loading the information. I don't know if this is directly due to the instance or the license I have.
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,405 NeuronWe upload files bigger than 1GB all the time. What kind of Dataiku instance do you use?
-
Marlan Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Dataiku Frontrunner Awards 2021 Participant, Neuron 2023 Posts: 330 NeuronWe did run into issues uploading mult-GB files to a folder. Zipping the file can help. Dataiku can create datasets directly from the zipped file.
See this post for background on our experience:
Marlan
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,405 Neuron
"There is no theoretical size limitation for uploading files to DSS."