AWS comprehend plugin error- TextSizeLimitExceededException

Solved!
pranauv
Level 1
AWS comprehend plugin error- TextSizeLimitExceededException

Hi,

We are trying to use AWS comprehend plugin, where we have setup the plugin preset as well,
When trying to use the plugin for a text dataset we are getting an error like below

(Error in Python process: At line 101: <class 'botocore.errorfactory.TextSizeLimitExceededException'>: An error occurred (TextSizeLimitExceededException) when calling the BatchDetectKeyPhrases operation: Input text size exceeds limit. Max length of request text allowed is 5000 bytes while in this request the text size is 5715 bytes)


Is there any option to increase the TextSizeLimit?

0 Kudos
1 Solution
Alex_Combessie
Dataiker Alumni

Hi,

This error is coming from a hard limit set on the AWS API.

Can you try reducing the "Batch size" parameter in the plugin preset? The default is 10, you can reduce it to 5, or even 1 to disable batching.

Screenshot 2021-02-02 at 15.50.55.png

Hope it helps,

Alex

View solution in original post

0 Kudos
1 Reply
Alex_Combessie
Dataiker Alumni

Hi,

This error is coming from a hard limit set on the AWS API.

Can you try reducing the "Batch size" parameter in the plugin preset? The default is 10, you can reduce it to 5, or even 1 to disable batching.

Screenshot 2021-02-02 at 15.50.55.png

Hope it helps,

Alex

0 Kudos