Submit your inspiring success story or innovative use case to the 2022 Dataiku Frontrunner Awards! ENTER YOUR SUBMISSION

Updating Snowflake SQL dataset every 30 minutes using specific criteria

info-rchitect
Level 3
Updating Snowflake SQL dataset every 30 minutes using specific criteria

Hi,

 

I currently handle this using Snowflake tasks but wanted to see if this could be ported to dataiku.  I want to only insert a row into the dataset if the columns UNIT_START_DATE and SERIAL_NUMBER are uniquely new else do nothing.  I want to run this check every 30 minutes.

 

thx


Operating system used: Windows 10

0 Kudos
1 Reply
HarizoR
Dataiker
Dataiker

Hi,

It would be possible to replicate such behaviour in DSS using a Scenario which would trigger every 30 minutes and execute a MERGE command inside a SQL step.

Best,

Harizo

0 Kudos