Add "work rate" line to ML Decision Chart

The Decision Chart in the Performance section of the screen you see after training a model in Visual ML is a really nice tool. (As are all of the visuals in the Performance section.)

However, it'd be even more useful if it included a "work rate" line. This would show what percent of the cases would be considered a "positive" at each Cut-off value. Thus one could say "if we set the cut-off to X, we'd select 5% of the cases and get precision of 50% and recall of 10%".  Currently the 5% is missing from the picture.

This would support a very common use case (at least in our organization) of setting a threshold to select cases for human intervention based not just on performance (such as precision and recall) but also on resources needed / available (a function of "work rate").   

3 Comments
Krishna
Dataiker

Thanks @Marlan , this is in our backlog.

Status changed to: In Backlog

Thanks @Marlan , this is in our backlog.

Good to hear! Thanks @Krishna.

Marlan

Good to hear! Thanks @Krishna.

Marlan

MichaelG
Community Manager
Community Manager
 
I hope I helped! Do you Know that if I was Useful to you or Did something Outstanding you can Show your appreciation by giving me a KUDOS?

Looking for more resources to help you use DSS effectively and upskill your knowledge? Check out these great resources: Dataiku Academy | Documentation | Knowledge Base

A reply answered your question? Mark as ‘Accepted Solution’ to help others like you!
Status changed to: In the Backlog