How do I set the logging level for Python recipes?

JamesLeslie

import logging
logging.basicConfig(level=logging.ERROR)

I have already tried the code above, but my recipe Python output still shows logs DEBUG and INFO.

It means it is very hard for me to find the output from my tqdm progress bar.

I am using DSS 13.3.3

Operating system used: Linux

Operating system used: Linux

Turribeach

As per this documentation link you are strongly advised to not customize log levels without input from Dataiku Support. Instead setup your own custom logging using Python's logging package which will then be "clean" of Dataiku's own logging.

JamesLeslie

That article doesn't really specify whether you can change the logging level for Python recipes, specifically, but rather DSS logging in general.

All I am really after is a way to see the progress of a long-running Python recipe as it's running.

Suppose your suggestion then is to create a separate logs file in an internal managed folder?

Turribeach

https://community.dataiku.com/discussion/comment/45315#Comment_45315

Same advice applies to recipe logging. And yes you should create your own logging and can expose it via a managed folder.