Discover this year's submissions to the Dataiku Frontrunner Awards and give kudos to your favorite use cases and success stories!READ MORE

Updating Snowflake SQL dataset every 30 minutes using specific criteria

info-rchitect
Level 4
Updating Snowflake SQL dataset every 30 minutes using specific criteria

Hi,

 

I currently handle this using Snowflake tasks but wanted to see if this could be ported to dataiku.  I want to only insert a row into the dataset if the columns UNIT_START_DATE and SERIAL_NUMBER are uniquely new else do nothing.  I want to run this check every 30 minutes.

 

thx


Operating system used: Windows 10

0 Kudos
1 Reply
HarizoR
Developer Advocate
Developer Advocate

Hi,

It would be possible to replicate such behaviour in DSS using a Scenario which would trigger every 30 minutes and execute a MERGE command inside a SQL step.

Best,

Harizo

0 Kudos