Get metrics history of a Model

camzis
camzis Registered Posts: 4 ✭✭✭

Hi

I would like to compare current RMSE metric of a Model with previous RMSE.

I am using a custom python check, I do not see in doc how to get historical metrics like I would do with a dataset.

Any suggestion is welcome!

Mamadou.


Operating system used: windows

Answers

  • HarizoR
    HarizoR Dataiker, Alpha Tester, Registered Posts: 138 Dataiker

    Hi Mamadou,

    In our latest version (Dataiku 10) you have a new model comparison feature that allows you to visually compare model performance results between multiple ML entities such as sessions or SavedModel versions.

    For a more programmatic approach, depending on where your comparison is taking place, you can use the public API to either retrieve:

    - a SavedModel's version metrics

    - a MLTask's session results

    Hope this helps.

    Best,

    Harizo

Setup Info
    Tags
      Help me…