Survey banner
Switching to Dataiku - a new area to help users who are transitioning from other tools and diving into Dataiku! CHECK IT OUT

MEMSIZE_TRUNCATED_SAMPLE: The sample size limit in MB was reached

MEMSIZE_TRUNCATED_SAMPLE: The sample size limit in MB was reached
I am uploading a CSV file with 500k rows and 181 columns. It all goes OK until I try to explore the data and then I only get 204k records loaded. I get an exclamation mark on the UI telling me I have hit the memory limit and the dataset has been truncated. The associated log entry is in the title. I have given the application 6GB of RAM so can't imagine it is hitting that for a CSV file that is 411MB big. I am the only user on the system right now.

Is there some other memory limit not mentioned in the Documentation?
2 Replies
Dataiker Alumni
When looking at the contents of a dataset, the rows are loaded in the memory of DSS.

The memory allocated to sampling has its own limit, set by the administrator. This is to prevent crashing the browser with insane sample sizes.

You can find this setting in: administration->settings->Limits
Level 1
Now (v5.1): Administration -> Settings -> Resources control
0 Kudos


Labels (2)
A banner prompting to get Dataiku