ZS Associates - Notification Framework: Enabling Notification for Success/Failure of the Data Flows
Ranjan Relan, Strategy & Architecture Manager Riya Srivastava, Business Technology Associate Consultant
Organization: ZS Associates
ZS Associates is a management consulting and professional services firm focusing on consulting, software, and technology, headquartered in Evanston, Illinois that provides services for clients in healthcare, private equity, and technology.
Users should get notified if the dataset build process/scenario is failing in Dataiku.
Implemented notification framework using Dataiku code environment, scenarios, and configuration to drop an email and Teams’ notification in case of any job failure/aborted along with the logs.
This has reduced manual monitoring and ensured a quick resolution in case of job failure. It has also reduced the recovery time in case of data unavailability for downstream teams.
Value Brought by Dataiku:
Dataiku provides the functionality of sending email notifications to users with minimum development using the client's SMTP server.
It also has a built-in email template that captures all the information required by the user in case a job fails or is aborted.
Dataiku provides dynamic variable calling from which we can easily add or remove an email distribution list without making any code changes.