How to access specific check results in a scenario

Hi Zach,

Thanks so much for the response. Unfortunately, it won't work for me. We are using the online instance of Dataiku and I just confirmed with tech support that the option to create custom variables (which requires an admin of the instance to enable "Write unisoloted code") is not available for Cloud instances of Dataiku.

So, I think I've gotten a way to use a Python step to get the information I need. I can put the values I need into a list called breach_list. Here is my code:

import dataiku
import pandas as pd, numpy as np
from dataiku import pandasutils as pdu

metric_list = ['cell:Incr_Std_Dev_MAE_Breach:Cell_Value',
               'cell:Std_Dev_MAE_Breach:Cell_Value',
               'cell:Incr_Scorability_Breach:Cell_Value']

dataset = dataiku.Dataset("Alerts_Dataset")
metrics = dataset.get_last_metric_values()
#ids = metrics.get_all_ids()
ids = metric_list

breach_list = []

for id in ids:
    metric_ID = id
    metric_name = metrics.get_metric_by_id(id)
    for value in metric_name['lastValues']:
        if value['value'] == 'true':
            print("Metric", id, "has value:", value['value'])
            string = id
            parts = string.split(':')
            string2 = parts[1]
            parts2 = string2.rsplit('_', 1)[0]
            breach_list.append(parts2)
    
print(breach_list)

Now, how do I get that "breach_list" into a message. I've tried to do this both through another step (a "send message" step) and via the reporters interface in the scenario settings, but no matter what I do I can't seem to access the breach_list. Someone also suggested this site (https://doc.dataiku.com/dss/latest/scenarios/custom_scenarios.html#send-custom-reports) as a means to send a custom report. How do I set up the message channel so that it uses the same teams webhook I have set up in the reporter? Could that then send the values in that breached_list using Python instead of JSON?

Thanks.

If you'll indulge me with just a little more assistance.

I got it to work, but had to alter your solution a little. Here is the code I used:

scenario = Scenario()
variable_param = {"breach_list": str(breach_list)}
scenario.set_scenario_variables(**variable_param)

This code worked for me; the code you gave threw an error. Probably because I'm doing this through an MS Teams message card.

Now I have a list of values that were originally created in a Python, called "breach_list". This list contains anywhere from 1 to 24 strings representing variables that have breached a threshold. I can now successfully access these variables in my final "send message" step. That step sends a message to an MS Teams page if a breach occurs (determined by if a check on the data fails). I want to be able to display the elements of that breach list, but right now all I can do is display the entire list. Here is what it looks like right now:

The JSON code in the MS Teams message is as follows:

@{
    "@type": "MessageCard",
    "@context": "https://schema.org/extensions",
    "themeColor": "${if(outcome == 'SUCCESS', '29AF5D', '')}${if(outcome == 'FAILED', 'F44336', '')}${if(outcome == '', '28A9DD', '')}",
    "summary": "${scenarioName} run report",
    "sections": [
        {
            "text": "${if(outcome == 'SUCCESS', '✅', '')}${if(outcome == 'FAILED', '🔴', '')}${if(outcome == '', '🔔', '')} ${scenarioName}: **${outcome}**",
            "facts": [
                { "name": "Project:", "value": "${scenarioProjectKey}" },
                { "name": "Triggered by:", "value": "${triggerName}" },
                { "name": "Thresholds breached:", "value": "${breach_list}"}
            ]
        }
    ],
    "potentialAction": [
        {
            "@type": "OpenUri",
            "name": "View Report",
            "targets": [
                { "os": "default", "uri": "https://dss-09e7274b-8eaa4b52-dku.us-east-1.app.dataiku.io/projects/LOOKERREPORTS/webapps/Jv8n57P_credit-score-monitoring-in-bokeh/view" }
            ]
        }
    ]
}

In the above code block, all I do is sent it ${breach_list}, but I'd really like to iterate through the elements of that list and print them each out on a separate line. Something like this:

Thresholds breached:

Increase in Scorability Mismatch

EXP Percent Problem Cases 7 Days or Less

EXP Percent Problem Cases 20 to 40 Days

Can you suggest how to do this in JSON and in an MS Teams messages card? Is there a construct to replace this line:

{ "name": "Thresholds breached:", "value": "${breach_list}"}

with something that iterates through the elements of breach_list and then lists them?

Thanks for all the help. I really appreciate it!