How can I check progress of LLM summarize recipe?
MyNamesJames
Registered Posts: 5 ✭
If I want to run the "summarize text" recipe on, say 20 000, documents - is there a way I can see the progress of the recipe while it's running?
Answers
-
Grixis PartnerApplicant, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 77 ✭✭✭✭✭Hello @MyNamesJames
There is a popular python library tqdm, which does the job well. This produces the progress of the documents with a loading bar in the job log of your recipe.
Look at : https://pypi.org/project/tqdm/ where you can find how to customize it for your use-case.
In attachement there is an example output you can have.
-
Hi there,
Thanks for the reply. Sorry, I should have been more specific. I was referring to the "LLM Summarize" visual recipe (not Python).Something like the tqdm bar would be great.