Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Added on March 13, 2025 10:01AM
Likes: 0
Replies: 4
Once the load of table is done and flow is successful add "1" to table value indicating load complete.
Can you please explain your requirement in detail not how you think you can implement it? There might be a better way of achieving what you want.
Meaning once the flow is completed , then in a ref table a true/false needs to be written. Based on that we will be updating the data in the final table if true. So basically what script can be used to find out flow completion status
This is the means of achieving a goal. What is your goal? Why do you need a table with a true false?
So to give you an idea of a bad pattern would that you want your table to have a True column/row so that you can refresh a report in your reporting layer once the flow is completed. This is a bad pattern since it uses a "poll" mechanism, the reporting layer is constantly polling the table for a true value after which it refreshes. This a bad pattern since it wastes a lot of compute resources to do the polling and does not refresh immediately (depending on the polling frequency). A better design will be to have Dataiku trigger the reporting layer refresh as part of the scenario flow. This is a "push" mechanism and much more efficient and able to handle things like reruns.