Survey banner
The Dataiku Community is moving to a new home! We are temporary in read only mode: LEARN MORE

How can I check progress of LLM summarize recipe?

MyNamesJames
Level 2
How can I check progress of LLM summarize recipe?

If I want to run the "summarize text" recipe on, say 20 000, documents - is there a way I can see the progress of the recipe while it's running?

0 Kudos
2 Replies
Grixis
Level 4

Hello @MyNamesJames 

There is a popular python library tqdm, which does the job well. This produces the progress of the documents with a loading bar in the job log of your recipe.

Look at : https://pypi.org/project/tqdm/ where you can find how to customize it for your use-case.

In attachement there is an example output you can have.

 

0 Kudos
MyNamesJames
Level 2
Author

Hi there,

Thanks for the reply. Sorry, I should have been more specific. I was referring to the "LLM Summarize" visual recipe (not Python).

Something like the tqdm bar would be great.

0 Kudos