Do you know the History of Data Science? READ MORE

USING AN SCENARIO TO REFRESH A SQL DATASET

anamtnez
Level 1
USING AN SCENARIO TO REFRESH A SQL DATASET

Hi everyone! 

I would like to use a based step scenario to automate the daily refresh of a SQL dataset (Oracle) to include the data changes of the dataset on the flow . I will use the time based trigger but im not sure about which steps I have to use in order to do that. 

If you guys could help me I would really appreciated!

 

Thanks!!

0 Kudos
2 Replies
AlexT
Dataiker
Dataiker

Hi,

To refresh a dataset you can simply build the dataset from a Scenario time-based trigger.

The steps would be :

1. In Scenario click on + New Scenario. Choose a name and ID

Screenshot 2021-07-02 at 12.01.23.png

2) Add the Daily trigger

Screenshot 2021-07-02 at 11.55.40.png

3) Add a Build/Train Step and click Add Dataset to BUILD and choose the dataset. 

Screenshot 2021-07-02 at 11.56.38.png

This will run the build dataset job daily.

You can find more information here : https://knowledge.dataiku.com/latest/courses/automation/scenarios-summary.html

Let me know if you have any further questions.

 

anamtnez
Level 1
Author

Thank you!! This was super useful!!

0 Kudos
A banner prompting to get Dataiku DSS