How can I check progress of LLM summarize recipe?

MyNamesJames
MyNamesJames Registered Posts: 5

If I want to run the "summarize text" recipe on, say 20 000, documents - is there a way I can see the progress of the recipe while it's running?

Answers

  • Grixis
    Grixis PartnerApplicant, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 77 ✭✭✭✭✭

    Hello @MyNamesJames

    There is a popular python library tqdm, which does the job well. This produces the progress of the documents with a loading bar in the job log of your recipe.

    Look at : https://pypi.org/project/tqdm/ where you can find how to customize it for your use-case.

    In attachement there is an example output you can have.

  • MyNamesJames
    MyNamesJames Registered Posts: 5

    Hi there,

    Thanks for the reply. Sorry, I should have been more specific. I was referring to the "LLM Summarize" visual recipe (not Python).

    Something like the tqdm bar would be great.

Setup Info
    Tags
      Help me…