How to generate report to find Number of jobs / Notebooks run on design node (over 1 week basis).

Options
kpk_devops
kpk_devops Registered Posts: 7 ✭✭✭

Hi,

I need to generate a report to find out how may jobs / notebooks ran on Design Node on daily / weekly basis, do we have any option to do the same in Dataiku ? please suggest.

Thanks in advance.

-Regards,

kpk.

Answers

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,595 Neuron
    Options

    @kpk_devops

    You may find this thread about pulling information out of the audit logs to be of help.

    https://community.dataiku.com/t5/Using-Dataiku-DSS/User-Login-History/m-p/13127#M5751

    The general idea is to create a connection to the location of the audit files, then roll the report you need from there.

    If that is not of help. Please share a bit more about how we can be of help.

  • kpk_devops
    kpk_devops Registered Posts: 7 ✭✭✭
    Options

    Hi ,

    Thank you for your response, I have created connection to "managed_folder" and generated the schema / list thru console, but when I grepped for the audit.log with command -> grep -i "dku.audit.*" audit.log, I see the apicall's count different with command and console, can you please suggest.

    Regards,

    KPK.

Setup Info
    Tags
      Help me…