Oracle Dataset using custom SQL query does not update and retain cached data.

SimonKFChung
Level 1
Oracle Dataset using custom SQL query does not update and retain cached data.

There is an Oracle dataset using a custom SQL query that is being used at the beginning of the flow.

When running it the first time, it will work and bring back current data. At the 2nd and subsequent runs, the sync recipe still brings back old data from 2 days ago. 

 

How can I change the sync recipe always to pull the latest dataset output retrieved from the custom SQL query?

Thanks.

 

Simon

0 Kudos
1 Reply
AlexT
Dataiker
Dataiker

Hi Simon,

Are you seeing the stale data in your sample? When re-running a sync recipe from a SQL dataset it would query the database with the original query. 

Can you try to "Save and Refresh" sample from the output dataset of the sync recipe and see if you are still seeing the same result?  You also have the option to "auto-refresh" the sample. 

Screenshot 2021-06-18 at 09.43.38.png

 

Let me know if this helps if not you may want to check your Sync recipe Job diagnostics logs or log a ticket with Support providing the job diagnostics logs.  

Thanks,

0 Kudos
A banner prompting to get Dataiku DSS
Public