Scenario run time logging

Options
Pkhande11
Pkhande11 Registered Posts: 6 ✭✭✭✭
in General Discussion

Hello Dataiku Community,

I would like to know how to extract scenario completion run time using custom python code or API.

I can see the runtime from Run logs. Is there a better way to extract those runtime for multiple scenarios?

Thanks!!

Tagged:
· Share on FacebookShare on Twitter

Answers

  • Alexandru
    Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,209 Dataiker
    Options

    Hi @Pkhande11
    ,

    You can see scenario runtime for all scenario accorss all projects by

    adding an Internal dataset ( + Dataset - Internal Stats - Scenario Runs - Preview( make sure to click preview before saving))

    Save to a dataset and use a prepare recipe to compute the duration based on start/end times. e.g Formula

    diff(time_end,time_start, 'seconds')

    Screenshot 2022-04-28 at 13.07.37.pngScreenshot 2022-04-28 at 13.10.44.png

    Let me know if this works in your case.

    · Share on FacebookShare on Twitter
  • Pkhande11
    Pkhande11 Registered Posts: 6 ✭✭✭✭
    Options

    Hi @AlexT
    ,

    Thanks for sharing the solution.

    My question is more around the runtime shared under "Last runs" tab as highlighted in the image below.

    Once the scenario is completed, we could see the List of Run logs (Success Run) and the total runtime for the scenario.

    dataiku_scenario_last_runs.PNG

    runtime_logs.PNG

    Can we extract those time duration? (highlighted ones)

    Thanks!!

    · Share on FacebookShare on Twitter
  • Ignacio_Toledo
    Ignacio_Toledo Dataiku DSS Core Designer, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 411 Neuron
    edited July 17
    Options

    Hi @Pkhande11
    ,

    I think the times you get with @AlexT
    instructions are the ones highlighted in your screenshots, is just that they are in seconds, and not formatted as a human-readable time range.

    For example, given this scenario log, with the highlighted scenario id:

    scenario02.png

    You'll find that the time matches the ones you can find using @AlexT
    instructions:

    scenario01.png

    I only added a new column with a formula, so the seconds were transformed to a human-readable format.

    Hope this helps!

    PS: By the way, the formula I used for the format, assuming the column with the time in seconds is called scenario_duration, is:

    '%02d hour(s), %02d minute(s), %02d seconds(s)'.format(scenario_duration//3600, scenario_duration % 3600 // 60, scenario_duration % 3600 % 60)

    · Share on FacebookShare on Twitter
  • Pkhande11
    Pkhande11 Registered Posts: 6 ✭✭✭✭
    Options

    Thanks @Ignacio_Toledo
    will check it out.

    · Share on FacebookShare on Twitter
Bookmark this topic

Categories

Setup Info
    Tags
      Help me…