Survey banner
Share your feedback on the Dataiku documentation with this 5 min survey. Thanks! TAKE THE SURVEY

Limited batch problem

ik007
Level 1
Limited batch problem

I am using a webapp to label some images, but the problem is it can only load a batch of 400 images at once, if I try to increase the batch size to 700 or 1000 or greater the webapp crashes.

Could you please tell how can I make the webapp handle 1000 or more than 1000 images batch 

Thank you

0 Kudos
2 Replies
SarinaS
Dataiker

Hi @ik007,

If you have a Kubernetes cluster available, you can run the webapp on a container by selecting the following option in the configuration settings and selecting an appropriate container configuration: 

Screen Shot 2022-09-29 at 2.48.06 PM.png

This can allow you to run the webapp on a container, scaling the available memory for the webapp. If that's not an option for you, then you are limited by the memory available on your DSS server and any cgroup limits. Batching is a good option in this case. 

Thanks,
Sarina 

0 Kudos
ik007
Level 1
Author

Hi @SarinaS 

I think using a container is not necessary if you we choose the type of your instance where the WebApp is running... So maybe we can choose a huge memory type for your instance.

Is it possible to set the webapp to use all of the available memory ?

0 Kudos