ZS Associates - Notification Framework: Enabling Notification for Success/Failure of the Data Flows
Name:
Ranjan Relan, Strategy & Architecture Manager
Riya Srivastava, Business Technology Associate Consultant
Country: India
Organization: ZS Associates
ZS Associates is a management consulting and professional services firm focusing on consulting, software, and technology, headquartered in Evanston, Illinois that provides services for clients in healthcare, private equity, and technology.
Awards Categories:
- Partner Acceleration
Business Challenge:
Users should get notified if the dataset build process/scenario is failing in Dataiku.
Business Solution:
Implemented notification framework using Dataiku code environment, scenarios, and configuration to drop an email and Teams’ notification in case of any job failure/aborted along with the logs.
Value Generated:
This has reduced manual monitoring and ensured a quick resolution in case of job failure. It has also reduced the recovery time in case of data unavailability for downstream teams.
Value Brought by Dataiku:
- Dataiku provides the functionality of sending email notifications to users with minimum development using the client's SMTP server.
- It also has a built-in email template that captures all the information required by the user in case a job fails or is aborted.
- Dataiku provides dynamic variable calling from which we can easily add or remove an email distribution list without making any code changes.