Overview of all running jobs

Options
MRvLuijpen
MRvLuijpen Partner, L2 Admin, L2 Designer, Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Dataiku DSS Adv Designer, Registered, Dataiku DSS Developer, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Frontrunner 2022 Participant, Neuron 2023 Posts: 107 Neuron
in Using Dataiku

Hello Community,

Is it possible to get an overview of all running jobs?

Is it possible by checking the internal metrics dss_jobs and then filtering on state empty?

This seems to provide an overview of all jobs running.

However, for example, if the job is partitioned, is it also possible to see all the sub-jobs running?

Another topic where this might be interesting is when using python and multiple threads are run in parallel.

In general, what I am looking for is the Dataiku equivalent of the linux command "top".

Thank in advance

· Share on FacebookShare on Twitter

Answers

  • VinceDS
    VinceDS Dataiker, Alpha Tester, Dataiku DSS Core Designer Posts: 45 Dataiker
    Options

    Hi,

    In the Administration > Monitoring section, you'll find a tab with Running Background Tasks that gives you info on running webapp backends, jobs / scenarios, and open notebook sessions.

    I'm not very familiar with the "top" command so that may not cover 100% of what you're looking for but still helpful.

    Screenshot 2020-02-27 at 13.04.06.png

    · Share on FacebookShare on Twitter
Bookmark this topic

Categories

Setup Info
    Tags
      Help me…