Manage DSS logs audit/audit.log

Abdoulaye

Hello, is there any options to limit audit logs saved locally? We sent our log via event-server to s3 (why these not sent to s3)

but there log are generated in dss ui.

I see this config in doc Logging and auditing — Dataiku DSS 13 documentation

, does that means I've already a default config of as I see audit in audit/audit.log

Does these file shown in screenshot mean there realy exist and occupy storage?

Thanks

Operating system used: awscloudstack

Turribeach

DSS rotates all logs automatically so you don't need to do anything here. It's worth having local logs in case something happens with your event server.

Abdoulaye

So all these shown files with 100Mbs do not realy stole storage to disk?

Turribeach

Abdoulaye

Jul 9, 2024

So all these shown files with 100Mbs do not realy stole storage to disk?

The storage is not stolen, it's used for a very valid purpose. And 20 audit 100 MB files is 2 GB which will never ever growing over that limit. 2 GB is such an insignificant amount of storage these days it's not even worth arguing about. Particularly in the context of all the other space that Dataiku uses in the file system. If you really want to reduce your space usage review the advice in the following documentation page:

https://doc.dataiku.com/dss/latest/operations/datadir.html

Abdoulaye

Turribeach

Jul 10, 2024

https://community.dataiku.com/discussion/comment/43951#Comment_43951

The storage is not stolen, it's used for a very valid purpose. And 20 audit 100 MB files is 2 GB which will never ever growing over that limit. 2 GB is such an insignificant amount of storage these days it's not even worth arguing about. Particularly in the context of all the other space that Dataiku uses in the file system. If you really want to reduce your space usage review the advice in the following documentation page:

https://doc.dataiku.com/dss/latest/operations/datadir.html

Thanks for your answers. This was realy about managing to send these log to s3 not to let them in dataiku ebs. If I understand only the 20 last file are conserved.

thanks