-
How to access specific check results in a scenario
I have a simple dataset containing 1 row and about 20 columns. Each column represents a Boolean value of whether or not a particular threshold has been breached. If the result is true for any of the 20 columns, then a message is sent to a designated MS Teams Channel that a breach has occurred. I would like to supplement…
-
Invalid Scenario step logic condition should cause scenario failure
I have noted a very dangerous behavior in the latest v12 release although I believe this has been in DSS for a long while. DSS will not cause a scenario failure or even a warning if you have an invalid Scenario step logic. For instance I created a scenario step and set two variables: {"var1": 123, "var2": 456} Then I…
-
Retrain the Partition Model
Hi, Initially i have trained the model for partition dataset and deployed the partitioned model (Partitioned on CITY column) . with model Id = 'XYZ' The requirement is to re train the partitioned model for all the partitions (The Number of partitions changes every time the dataset is reloaded) and activate the latest…
-
Display user id on Scenario Last Runs screen
I am surprised this is missing from the GUI but what really surprises me more is that it's not even shown in the logs.The fact that one needs to query the API to get this data should be a good indication that both logging and GUI need to have an overhaul. I have posted a Product Idea feel free to vote for it. It also asks…
-
Assistance Needed with Custom Python Triggers in Dataiku
Hello Folks, I recently created a project in Dataiku aimed at collecting metric data at the beginning and end of each month. Here is a quick summary of my project: I used a scenario to execute an SQL query and set up triggers for the beginning and end of the month, with specific parameters to launch only on working days.…
-
Launch scenario if dataset is not empty
Hello, I would like to trigger one step of my scenario if one of my dataset is not empty. What I did is: 1- Create Check in my dataset (that I called NUMBER_RECORDS) to verify that record count>1 (img1) . 2- Create "Run Check" step on this dataset. 3- Create step I would like to launch based on condition…
-
Exclude specific dataset build from scenario
Hello, I need to exclude a part of my flow from being built during the execution of a scenario, because this part is to built only once in a while. For now, I have to do it in "Build only these items" mode and list all the datasets I actually want to build. Would it be a way to exclude the few datasets I DON'T want to…
-
Setting up Scenario to Run a step once a day
All, I have a data flow that starts with a flow zone that takes a long time to run. I'd like to run this first flow zone just once a day. Is anyone aware of a good simple way to run that zone the first time the scenario runs each day the first step will run. Then every other time the scenario runs the step is checked and…
-
Dataiku Scenario
I need to run a scenario within the same scenario(recursion or self call). It is basically running the scenario within a loop until a condition is failed or satisfied. Please help.
-
How to add a custom calculated model metric into the evaluation store in Dataiku?
Hello everyone, I am currently working on a project in Dataiku and trying to log a custom model metric into the evaluation store. The model is not a visual ml model its a custom model that is logged in Dataiku as a saved model using the mlflow integration that Dataiku offers. However, I am not sure how to add a custom…