Allow flow nodes to be bypassed conditionally

info-rchitect
info-rchitect Registered Posts: 174 ✭✭✭✭✭✭

Hi,

As I start to use dataiku to standardize analysis chains, there are product specific data preparation nodes that are not always needed. Currently, if I want multiple products to use the same flow, I have to embed custom logic in many recipe nodes. It would be great, if nodes could be bypassed (grayed out) but not taken from the flow, using some global variable.

thx

2
2 votes

In the Backlog · Last Updated

Comments

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,925 Neuron

    Couldn't you do this by building specific Scenarios that only run the required parts of your flow? Note that a Scenario can run another Scenario so you can easily nest/group your flow using this technique.

  • info-rchitect
    info-rchitect Registered Posts: 174 ✭✭✭✭✭✭

    @Turribeach
    Yes I could do that but that is pretty complicated as well. The business logic could be 10+ nodes in the flow. I imagine a base flow that works out of the box if a product doesn't have dirty data. If a product does add in nodes to massage their data, they are tagged with a product bypass flag so the scenario can just build the base nodes, which would hit the product-specific nodes if they exist and are not bypassed.

  • Katie
    Katie Dataiker, Registered, Product Ideas Manager Posts: 106 Dataiker

    Thanks for the feedback @info-rchitect
    , we've logged this request and will let you know if we have any updates.

    Katie

Setup Info
    Tags
      Help me…