Weighting method documented in ML Model Results?

Marlan
Marlan Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Dataiku Frontrunner Awards 2021 Participant, Neuron 2023 Posts: 319 Neuron

Hi all,

I have been unable to find documentation of the weighting method setting in the model results summary. Is it not there or am I just somehow missing it?

I typically compare the performance of weighting (class weights) and no weighting methods when tuning my models. I'd like to be able to look at the results summary and see whether weighting was used.

Thanks,

Marlan


Operating system used: RHEL

Best Answer

  • AdrienL
    AdrienL Dataiker, Alpha Tester Posts: 196 Dataiker
    Answer ✓

    Hi,

    There is no fully explicit reminder of the exact weighting method, you'd have to use the API to retrieve that. We will consider this feedback to add this explicitly on the UI in a future version of DSS.

    If it can help, there is an indication of whether sample weights were used (i.e. if either the "Sample weights" or the "Class and sample weights" method was selected). If so:

    • In the Features tab, the corresponding feature shows up as Weights
    • In the Metrics tab, all metrics appear as "Weighted [metric name]"
    • In the Summary tab and the model snippet (in the session view), there is a Sample weights variable mention
    • In multiple result tabs, there is a icon on top with the name of the weights column + a tooltip on hover

    Screenshot 2024-05-17 at 14.11.50.pngScreenshot 2024-05-17 at 14.13.01.pngScreenshot 2024-05-17 at 14.13.55.png

Answers

  • Marlan
    Marlan Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Dataiku Frontrunner Awards 2021 Participant, Neuron 2023 Posts: 319 Neuron

    Thanks much for the reply @AdrienL
    .

    Good to know about the indications of whether Sample weights or Class and sample weights were used. I'm typically switching between Class weights and no weighting though.

    Yes, it would be great to have the weighting method documented. Everything else is so it seems reasonable that this would be too so there is complete documentation.

    Thanks,

    Marlan

Setup Info
    Tags
      Help me…