Capture and Send Scenario Logs to Specific Location

clayms

Is it possible to capture the logs from a specific Scenario run in an application?

---

Operating system used: centos

Turribeach

You can send logs to Kafka:

https://doc.dataiku.com/dss/latest/operations/audit-trail/centralization-and-dispatch.html#kafka-target

Or you can use the DSS Event Server:

https://doc.dataiku.com/dss/latest/operations/audit-trail/eventserver.html

to send audit logs to other technologies/locations. But this is intended for audit trail logs not for scenario logs. Scenario logs are stored in a directory (see https://doc.dataiku.com/dss/latest/operations/disk-usage.html#scenario-logs) so nothing stops you from developing a process to load them somewhere.

But what will be the purpose of doing so? What are you really trying to achieve?

clayms

we want to keep a tight watch on numerous processes.

Currently we use K8s-pods-stdout-stderr > Fluentd > Splunk .

Wondering how to do something similar in Dataiku.