Build a flow

Parunyu
Parunyu Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 3 Partner

How it different between build upstream only modify and build all upstream. In the lesson it tells that build only modify is different only time, but I need to know that there is any point that are different or not ?

Best Answer

  • Sean
    Sean Dataiker, Alpha Tester, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer Posts: 168 Dataiker
    Answer ✓

    Hi @Parunyu
    , I believe you are referring to this lesson (https://knowledge.dataiku.com/latest/data-preparation/pipelines/concept-dataset-build-modes.html) and have a question about the difference between the build modes build upstream (only modified) and build all upstream.

    Build all upstream is a forced recursive build. No matter whether a dependent dataset is up to date or not, it will recompute all dependencies. Build upstream (only modified), which is the default, will take into account whether a dependent dataset is out of date or not. It won't recompute what doesn't need to be recomputed. So often this option can save computation time.

Answers

Setup Info
    Tags
      Help me…