USING AN SCENARIO TO REFRESH A SQL DATASET
Hi everyone!
I would like to use a based step scenario to automate the daily refresh of a SQL dataset (Oracle) to include the data changes of the dataset on the flow . I will use the time based trigger but im not sure about which steps I have to use in order to do that.
If you guys could help me I would really appreciated!
Thanks!!
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,209 DataikerOptionsHi,
To refresh a dataset you can simply build the dataset from a Scenario time-based trigger.
The steps would be :
1. In Scenario click on + New Scenario. Choose a name and ID
2) Add the Daily trigger
3) Add a Build/Train Step and click Add Dataset to BUILD and choose the dataset.
This will run the build dataset job daily.
You can find more information here : https://knowledge.dataiku.com/latest/courses/automation/scenarios-summary.html
Let me know if you have any further questions.
-
Thank you!! This was super useful!!