ZS Associates - Notification Framework: Enabling Notification for Success/Failure of the Data Flows

sonal_18

Name:

Ranjan Relan, Strategy & Architecture Manager
Riya Srivastava, Business Technology Associate Consultant

Country: India

Organization: ZS Associates

ZS Associates is a management consulting and professional services firm focusing on consulting, software, and technology, headquartered in Evanston, Illinois that provides services for clients in healthcare, private equity, and technology.

Awards Categories:

• Partner Acceleration

Business Challenge:

Users should get notified if the dataset build process/scenario is failing in Dataiku.

Business Solution:

Implemented notification framework using Dataiku code environment, scenarios, and configuration to drop an email and Teams’ notification in case of any job failure/aborted along with the logs.

Value Generated:

This has reduced manual monitoring and ensured a quick resolution in case of job failure. It has also reduced the recovery time in case of data unavailability for downstream teams.

Value Brought by Dataiku:

• Dataiku provides the functionality of sending email notifications to users with minimum development using the client's SMTP server.
• It also has a built-in email template that captures all the information required by the user in case a job fails or is aborted.
• Dataiku provides dynamic variable calling from which we can easily add or remove an email distribution list without making any code changes.