-
Custom trigger to run itself?
Hi everyone, I want to execute scenario again if its fail, so it can try 3 times, sometimes kubernetes fails or, spark fails could be fixed after run again so, i dont miss time range between fail and fix manually. This is the code created with LLM, it used python for that. I changed project name to variable "project name",…
-
How to use "Execute Python unit test" scenario step
A new scenario step was added in a recent DSS version which is to execute a Python unit test. I'd like to start using this. However, the documentation is pretty brief: "this step executes one or more Python pytest tests from a project’s Libraries folder using a Pytest selector". Anyone have more details on or an example of…
-
Custom trigger does not executes python code
Hi, I am quite new in Dataiku and I am interested why the following code does not work as expected. Namely, I am trying to define custom trigger that will check if the folder is empty. Both from dataiku.scenario import Trigger t=Trigger() folder = dataiku.Folder("folder_id") files = folder.list_paths_in_partition() if…
-
Group by with empty value and with Null value
Hello everyone ! I have a dataset with empty values in one of the columns (col1) and I use a group by recipe on an other column (col2) without empty values with col1_distinct as aggregation. I get a volume of 21, 199 and 1608 for the 3 col2 fields. But I wanted to add a condition on col1 with a prepare recipe with a…
-
schema propagation problem
In the dataset explore, I can define 'description' using 'edit column schema'. And I can propagate the schema to the following 'flow' using 'schema propagation'. However, sometimes it is not inherited (if there is a 'prepare recipe' in the middle) I want to know how to inherit it normally.
-
how can I make a Django app in Dataiku ?
I'm looking for information regarding coding a Django application in Dataiku. Any information on how to achieve this ? thanks
-
How to set up a random forest regression?
-
Ommiting quotes around scenario string variables in a Freemarker email template
Hi, I have a scheduled project scenario that sends an email on some condition. The scenario contains a step that sets scenario variables based on values in a dataset. Here's that step: import dataiku import dataiku.scenario # Read the dataset df = dataiku.Dataset("node-disk-usage").get_dataframe() use_percentage_threshold…
-
SQL Step to copy table
Hi, was trying to run insert statement as step in scenario , it's loading only 10 records can you please guide me what could be the issue?
-
How to check for consecutive monthly buys
i have a dataset that has purchasing history for many items for the past 10 years, i want to pull out only the items that have been purchased every month for the last 10 years. how do i go about this? Operating system used: macos