Oracle Dataset using custom SQL query does not update and retain cached data.

Options
SimonKFChung
SimonKFChung Dataiku DSS Core Concepts, Registered Posts: 1 ✭✭✭

There is an Oracle dataset using a custom SQL query that is being used at the beginning of the flow.

When running it the first time, it will work and bring back current data. At the 2nd and subsequent runs, the sync recipe still brings back old data from 2 days ago.

How can I change the sync recipe always to pull the latest dataset output retrieved from the custom SQL query?

Thanks.

Simon

Answers

  • Alexandru
    Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,209 Dataiker
    Options

    Hi Simon,

    Are you seeing the stale data in your sample? When re-running a sync recipe from a SQL dataset it would query the database with the original query.

    Can you try to "Save and Refresh" sample from the output dataset of the sync recipe and see if you are still seeing the same result? You also have the option to "auto-refresh" the sample.

    Screenshot 2021-06-18 at 09.43.38.png

    Let me know if this helps if not you may want to check your Sync recipe Job diagnostics logs or log a ticket with Support providing the job diagnostics logs.

    Thanks,

Setup Info
    Tags
      Help me…