Logging to Azure
Hi
I'm trying to send my audit logs to an Azure BlobStorage.
I read in the documentation that this can be done in the log4j settings file, but the documentation is lacking in a workable example. Im not a log4j expert, but Ive seen that generally i would need an "appender" specifically for this connection. Does such functionality ship with the default log4j appender and if so what is the syntax.
As another option I've opened a Event Server on the same node as my design node, and configured it with an Azure storage path but its not sending anything there....
Any help would be appreciated (especially with an example)
Operating system used: Linux
Answers
-
Keiji Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 52 DataikerOptionsHello @danf101
,Thank you for the post on Community.
By using the DSS Event Server, you can collect your DSS nodes' audit logs into a single node ("auditing node"), and write the audit logs from the "auditing node" to Azure Blob Storage.
First, you need to install the Event Server on the "auditing node". Please follow the steps described here: https://doc.dataiku.com/dss/latest/operations/audit-trail/eventserver.html#installing-the-event-server
Next, you will need to create an Azure Blob Storage Connection on the "auditing node" as follows.
Please see https://doc.dataiku.com/dss/latest/connecting/azure-blob.html for how to create an Azure Blog Storage Connection.
After that, on the DSS UI of the "auditing node", you will need to set up the configuration of the Event Server on "Administration" > "Settings" > "Event Server" page as follows:
Please see https://doc.dataiku.com/dss/latest/operations/audit-trail/eventserver.html#configuration-of-the-event-server how to configure the Event Server.
Then, on each DSS node, you will need to configure the auditing to dispatch logs to the Event Server on "Administration" > "Settings" > "Auditing" page as follows.
As a result, audit logs will be written from the Event Server to Azure Blob Storage as follows.
I hope this would help.
Please let us know if you have any further questions.
Sincerely,
Keiji, Dataiku Technical Support -
danf101 Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 4 PartnerOptions
Thanks! We already have a running audit node - just didn't know if that was the preferred way, and did'nt know how to set it up.
I'll give it a try!