Run python Recipe with Scenario
Hi,
I have a Python recipe that takes two datasets as inputs and provides a dataset as output, now I want to run this recipe with a scenario and run it every day at a specific time.
How can I run this recipe?
Thanks
Best Answer
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023, Circle Member Posts: 2,722 NeuronYou don't. You select the output dataset as I said before. Building the output dataset requires running the recipe so that's what Dataiku will do.
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023, Circle Member Posts: 2,722 Neuron
Create a scenario and add a build step with the output dataset on it. Set a scenario trigger with your desired schedule.
-
How do I select that Python recipe to run with the scenario?
-
Hi,
I used this process, but in specific case like follow , it does not work:
In my scenario , I have a dataset A fill by command build. This dataset is update by adding a specific column by recipe Prepared to give dataset B.
In my case, a new column appears in the dataset A. But when I build , by scenario , the dataset B I don't see the new column.
But in workflow, If I use the Run button of the recipe Prepare, the new column appear in dataset B.
Do you have an idea to get the new column in my DS B ?
PS : sorry for my english , I'm French.
Thank for you help
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,399 Dataiker@John59
Note, this is probably best handled via a new post.
But are you propagating the schema in the scenario?
If not, please try adding this option and try again.
If this stil doesn't work , I would suggest opening a support ticket with the scenario diagnostics
