Survey banner
The Dataiku Community is moving to a new home! We are temporary in read only mode: LEARN MORE

How to monitor jobs consumption resources

Level 2
How to monitor jobs consumption resources

Hi everyone,

Is there any way in Dataiku DSS that a user can see how many resources (memory, storage and CPU) are taking his active jobs ?

I have DSS installed in a Hortonworks cluster and as I am a Hortonworks admin I can see jobs resource consumption in Yarn, but I don't want to open Yarn for all users.

Therefore I need a way for users to be able to see how are their jobs consuming cluster resources.


Operating system used: Linux CentOS

0 Kudos
1 Reply

Hi @azamora 

There is no UI metrics/monitoring for this but you may want to have a look at CRU (Compute Resource Usage) that we added in DSS8:


0 Kudos