Dataiku monitoring

hello community !

I hope this message finds you well.

I am currently working on a project that involves integrating Dataiku DSS (Data Science Studio) with Azure's monitoring tools, specifically Azure Monitor and Azure Log Analytics Workspace. Our goal is to ensure comprehensive monitoring and logging for our Dataiku environment to enhance our observability and troubleshooting capabilities.

I would greatly appreciate your insights and recommendations on the following points:

1. Methods for Extracting/Push Logs from Dataiku to Azure:

   • What are the best practices for extracting logs from Dataiku DSS?
   • Are there any specific tools or plugins that facilitate the integration with Azure Monitor or Azure Log Analytics Workspace?
   • How can we automate the process of pushing these logs to Azure?

2. Types of Logs for Monitoring Dataiku DSS:

   • What types of logs are most useful for monitoring the performance and health of Dataiku DSS?
   • Are there specific log categories (e.g., application logs, system logs, user activity logs) that we should focus on?
   • How can we leverage these logs to proactively identify and resolve issues within our DSS environment?

Any guidance, documentation, or examples you can provide would be incredibly helpful. If anyone has experience with a similar setup or can point me toward relevant resources or tutorials, I would be very grateful.

Thank you in advance !