How to monitor resource usage of recipes by time zone
Hello.
Is there a way to monitor the CPU, MEM, and other resource usage for each recipe in a project by time zone in Dataiku?
I understand there's CRU, but can I also use it to monitor each recipe by time zone?
Operating system used: REHL 9.4
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,381 DataikerHi,
If you have the CRU project and audit CRU data available on your instance
https://doc.dataiku.com/dss/latest/operations/compute-resource-usage-reporting.html
You can leverage the built-in charts like
https://knowledge.dataiku.com/latest/solutions/governance/solution-cru.html#consumption-report
You can also customize the project add new charts that cater to your specific needs.Thanks
-
You will need to export the job metrics from the DSS API and aggregate them yourself. In this case, you will see CPU usage, memory usage, etc. over time.