Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Hi,
We've seen that the project variables used by the recipes in a recursive build aren't synchronized when the recipe is ran.It seems the project variables are set at the begining of the recursive build and may cause some asynchronous events.
I explain the mechanic we've understood :
Could you confirm this mechanic ?
Is there a place in the Dataiku documentation confirming this behavior ?
Greetings,
Steven
Hi @sseveur ,
I assume you are using get_custom_variables() to read the project variable values? This would read the values at the start of the recipe/flow rebuild thus would have the behaviour you describe.
If you want the read the updated values set with set_variables() in the recipe you can read the variable using get_variables() instead.
vars = project.get_variables()
current_variable_value = vars["standard"]["my_variable"])
#this would return the variables at the start of the variable run
variable_at_start_of_recipe_run = dataiku.get_custom_variables()["my_variable"]
Hi,
No we are using the variables through the ${variable_name} in a SQL recipe that's the main problem.
Didn't know there was a difference between the API call and the get_custom_variables(). Thanks for the info.