Setup & Configuration
- Hello ! I'm currently working on a DSS instance, having fun building data piplines, but it's running out of memory after 2hrs. DSS is installed manually on a docker image. We tryed several setup with …Last answer by Alexandru
Hi @Bap
,
It is hard to advise based on this information alone.
How much memory have you allocated to the DSS container itself?
What behavior are you seeing when, say it run "out of memory"?
The jek 4g is more the default value. You should look to reduce this back to 2g.
The Jek processes remain open as DSS reuses them, but this should not cause issues or consume a high level of resources.You need to check the number of concurrent executions allowed and the total memory.
The default is you should leave this at the default value unless you have adequate sized instance.
.
Note we recommend using groups to limit the usage of java processes, but this will not work in the container. Hence why installing DSS in the container is not recommended:https://doc.dataiku.com/dss/latest/installation/other/container.html
https://doc.dataiku.com/dss/latest/operations/cgroups.html
Please try to capture the instance diagnostics while the issue is occurring if possible.
https://doc.dataiku.com/dss/latest/troubleshooting/diagnosing.html
I would suggest you capture an instance diagnostics and submit a support to understand what is causing the memory usage. - The https://doc.dataiku.com/dss/latest/operations/monitoring.html#concepts documentation describe how to push DSS metrics to a graphite server. However, is it possible to push metrics to an existing p…
- Is there a way to * query the number of waiting activities due to insufficient slots i. at any given time ii. Historically? * differentiate an activity in waiting status because it’s awaiting an upstr…Last answer by
- Resource management & Scaling horizontally with Kubernetes Given that activities within the same job run as threads within the same JEK process. How do you size the Kubernetes pods accordingly? A job …Last answer by
- Under My Settings is an option to allow or disable various notifications (user log in/out, edit of watched objects, etc). However, the appearance of these notifications in the bottom right corner of t…Last answer by
- Hi, is there a way to limit the log size when running a job? Sometimes we run a job and that fails. When this happens all temp data and logging is stored which leads to disk space issues. In no time l…Last answer by
- As a follow up to https://community.dataiku.com/t5/Setup-Configuration/Feature-request-Monitor-memory-usage-per-scenario/m-p/1823#M322, it sure seems like this has been implemented via https://doc.dat…Last answer by
- We have multiple administrators in our Dataiku instance. Let us say they are administrators A and B. Is it possible to give a specific project permission only to administrator A and not to B? Can the …Solution by
- When multiple users edit the same item in DSS, a popup appears that shows all users on an item, and also shows a list of all users on DSS. I have a few questions: First, is there a way to stop this po…Solution by
- Good afternoon, During my work I always see notifications in the bottom right corner, indicating which user is just connected and which user is just disconnected. It is not working properly and is ver…Last answer by