retrying a failed partition
pkansal
Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Registered Posts: 23 ✭✭✭✭
If a particular partition fails in my workflow, the whole step in the scenario repeats. I know that in the next step I can add "build required datasets" and it will build the failed partition. But what if there is no next step. The step involving partitions is the last step.
Tagged:
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,212 Dataiker@pkansal
,To really cover this case you will need to add the last step and only run it if the previous step failed you can also reset the scenario state.
If you have multiple steps before you can use a "if condition satisfied" to run the last step only if previous steps running partitioned dataset builds failed
https://doc.dataiku.com/dss/latest/scenarios/step_flow_control.html#if-condition-satisfied