Error when using Embed recipe

Sukumaran Adarsh

Hi Team,

When I am trying to embed a dataset in Dataiku with textual data, I encounter this error: Error in Python process: <class 'Exception'>: At least one embedding request failed: HTTP code: 429, response: { "statusCode": 429, "message": "Token limit is exceeded. Try again in 48 seconds." }
Could you guys please help me with why this error is getting triggered and how to avoid it.

Alexandru

Hi,
"Token limit is exceeded. Try again in 48 seconds.", is caused by exceeding the rate limit for LLM you are using.
You can try to increase the limits on the LLM side.

On the Dataiku LLM connection, you can try to reduce parallelism/ increase first retry delay/retry delay scale and max retries.