Discover all of the brand-new features and improvements to existing capabilities in the Dataiku 11.3 updateLET'S GO

Scenario to notify when a row is added to a table

Solved!
me2
Level 1
Scenario to notify when a row is added to a table

Hi, using a data analyst license (no Python or R), I'm looking to create a scenario that notifies only when a row is added.  The trick is my workflow only pulls data and recreates a final table.  If the previous table had 3 rows, the new table might have 3 or more rows.  If 1 or more rows were added, then the table was changed.

I am able to send the scenario with the new table but now I want it to be conditional and only send the new rows.

How can I do that without using Dataiku's visual recipes and scenarios?

0 Kudos
1 Solution
shashank
Dataiker

I might not have understood your use case fully. But based on what I got, if you're looking to identify a way of triggering workflow based on row insert, you can do that by using SQL Change in Scenarios - Trigger Dropdown.

For Workflow to only process new rows, if you have an identifier like a timestamp to identify new rows you can either use partitions and configure to only run new partitions or you have to write your own custom SQL to handle this logic using SQL Recipe. 

 

View solution in original post

0 Kudos
1 Reply
shashank
Dataiker

I might not have understood your use case fully. But based on what I got, if you're looking to identify a way of triggering workflow based on row insert, you can do that by using SQL Change in Scenarios - Trigger Dropdown.

For Workflow to only process new rows, if you have an identifier like a timestamp to identify new rows you can either use partitions and configure to only run new partitions or you have to write your own custom SQL to handle this logic using SQL Recipe. 

 

0 Kudos