How do I set the logging level for Python recipes?

import logging logging.basicConfig(level=logging.ERROR)
I have already tried the code above, but my recipe Python output still shows logs DEBUG and INFO.
It means it is very hard for me to find the output from my tqdm
progress bar.
I am using DSS 13.3.3
Operating system used: Linux
Operating system used: Linux
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,248 Neuron
As per this documentation link you are strongly advised to not customize log levels without input from Dataiku Support. Instead setup your own custom logging using Python's logging package which will then be "clean" of Dataiku's own logging.
-
That article doesn't really specify whether you can change the logging level for Python recipes, specifically, but rather DSS logging in general.
All I am really after is a way to see the progress of a long-running Python recipe as it's running.
Suppose your suggestion then is to create a separate logs file in an internal managed folder?
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,248 Neuron
Same advice applies to recipe logging. And yes you should create your own logging and can expose it via a managed folder.