Get metrics history of a Model
camzis
Registered Posts: 4 ✭✭✭
Hi
I would like to compare current RMSE metric of a Model with previous RMSE.
I am using a custom python check, I do not see in doc how to get historical metrics like I would do with a dataset.
Any suggestion is welcome!
Mamadou.
Operating system used: windows
Answers
-
Hi Mamadou,
In our latest version (Dataiku 10) you have a new model comparison feature that allows you to visually compare model performance results between multiple ML entities such as sessions or SavedModel versions.
For a more programmatic approach, depending on where your comparison is taking place, you can use the public API to either retrieve:
- a SavedModel's version metrics
Hope this helps.
Best,
Harizo