Discover this year's submissions to the Dataiku Frontrunner Awards and give kudos to your favorite use cases and success stories!READ MORE

Logging to Azure

danf101
Level 2
Level 2
Logging to Azure

Hi

I'm trying to send my audit logs to an Azure BlobStorage.
I read in the documentation that this can be done in the log4j settings file, but the documentation is lacking in a workable example. Im not a log4j expert, but Ive seen that generally i would need an "appender" specifically for this connection. Does such functionality ship with the default log4j appender and if so what is the syntax.
As another option I've opened a Event Server on the same node as my design node, and configured it with an Azure storage path but its not sending anything there....

Any help would be appreciated (especially with an example)


Operating system used: Linux

0 Kudos
2 Replies
KeijiY
Dataiker
Dataiker

Hello @danf101 ,

Thank you for the post on Community.

By using the DSS Event Server, you can collect your DSS nodes' audit logs into a single node ("auditing node"), and write the audit logs from the "auditing node" to Azure Blob Storage.

First, you need to install the Event Server on the "auditing node". Please follow the steps described here: https://doc.dataiku.com/dss/latest/operations/audit-trail/eventserver.html#installing-the-event-serv...

Next, you will need to create an Azure Blob Storage Connection on the "auditing node" as follows.

Screen Shot 2022-01-31 at 13.06.22.png

Please see https://doc.dataiku.com/dss/latest/connecting/azure-blob.html for how to create an Azure Blog Storage Connection.

After that, on the DSS UI of the "auditing node", you will need to set up the configuration of the Event Server on "Administration" > "Settings" > "Event Server" page as follows:

Screen Shot 2022-01-31 at 13.10.25.png

Please see https://doc.dataiku.com/dss/latest/operations/audit-trail/eventserver.html#configuration-of-the-even... how to configure the Event Server.

Then, on each DSS node, you will need to configure the auditing to dispatch logs to the Event Server on "Administration" > "Settings" > "Auditing" page as follows.

Screen Shot 2022-01-31 at 13.13.53.png

As a result, audit logs will be written from the Event Server to Azure Blob Storage as follows.

Screen Shot 2022-01-31 at 13.16.23.png

I hope this would help.

Please let us know if you have any further questions.

Sincerely,
Keiji, Dataiku Technical Support

danf101
Level 2
Level 2
Author

Thanks! We already have a running audit node - just didn't know if that was the preferred way, and did'nt know how to set it up.
I'll give it a try!