evolution of hyperparameter values going down
Options
YukiN
Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 11 Dataiker
As shown in the image, sometimes the score is adjusted in the direction of going down, how does this work? I understood that in most cases the score would go up.
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,209 DataikerOptionsHi,
Dataiku auto-selects the best-performing model during the training not the latestAs explained here:
DSS only shows the best score found so far, so the graph will show “ever-improving” results, even though the latest evaluated model might not be good
https://doc.dataiku.com/dss/latest/machine-learning/advanced-optimization.html#visualization-of-hyperparameter-search-results
You can see the selected model has 0.947, even if at the end of the graph the score is <0.9