What are the ways to export logs from an entire flow

clayms Registered Posts: 52 ✭✭✭✭

I want to export the logs from an entire flow to an external service. The flow contains the following: pyspark, and python code recipes, visual recipes, various connections to databases, and object stores.

How can I get the logs from all of those project flow processes exported to one location without any of the unnecessary Dataiku Design Node logs.

Operating system used: centos

Setup Info
      Help me…