How can I check progress of LLM summarize recipe?

Registered Posts: 5

If I want to run the "summarize text" recipe on, say 20 000, documents - is there a way I can see the progress of the recipe while it's running?

Answers

  • PartnerApplicant, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 103 ✭✭✭✭✭✭

    Hello @MyNamesJames

    There is a popular python library tqdm, which does the job well. This produces the progress of the documents with a loading bar in the job log of your recipe.

    Look at : https://pypi.org/project/tqdm/ where you can find how to customize it for your use-case.

    In attachement there is an example output you can have.

  • Registered Posts: 5

    Hi there,

    Thanks for the reply. Sorry, I should have been more specific. I was referring to the "LLM Summarize" visual recipe (not Python).

    Something like the tqdm bar would be great.

Welcome!

It looks like you're new here. Sign in or register to get started.

Welcome!

It looks like you're new here. Sign in or register to get started.