Retry (a) failed partition(s)

Options
casper
casper Registered Posts: 42 ✭✭✭✭

Hi all,

In Dataiku 7 the possibility of retrying scenario steps was added. From the way I read it at the moment, this means it retries the entire step when it fails. Is it however possible that it only retries the specific partitions the job is failing on? Right now the entire job fails, but redoing all the partitions isn't always possible. In this case it's about SQL partitions but I think the question is more generally.

Thanks in advance

Answers

  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer, Registered Posts: 753 Dataiker
    Options

    Hi,

    If your build step is in "Build required" mode (the default), then re-running the step will only build the failed/not done partitions. The already-built partitions will be pruned automatically because DSS will determine that they are not "required" anymore since they are up-to-date.

Setup Info
    Tags
      Help me…