Capture and Send Scenario Logs to Specific Location

[clayms]

Is it possible to capture the logs from a specific Scenario run in an application? 

---

Operating system used: centos

[Turribeach]

You can send logs to Kafka:

https://doc.dataiku.com/dss/latest/operations/audit-trail/centralization-and-dispatch.html#kafka-tar...

Or you can use the DSS Event Server:

https://doc.dataiku.com/dss/latest/operations/audit-trail/eventserver.html

to send audit logs to other technologies/locations. But this is intended for audit trail logs not for scenario logs. Scenario logs are stored in a directory (see https://doc.dataiku.com/dss/latest/operations/disk-usage.html#scenario-logs) so nothing stops you from developing a process to load them somewhere.

But what will be the purpose of doing so? What are you really trying to achieve?

[clayms]

we want to keep a tight watch on numerous processes. 

Currently we use K8s-pods-stdout-stderr > Fluentd > Splunk . 

Wondering how to do something similar in Dataiku.