Limited batch problem
I am using a webapp to label some images, but the problem is it can only load a batch of 400 images at once, if I try to increase the batch size to 700 or 1000 or greater the webapp crashes.
Could you please tell how can I make the webapp handle 1000 or more than 1000 images batch
Thank you
Answers
-
Sarina Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 317 Dataiker
Hi @ik007
,
If you have a Kubernetes cluster available, you can run the webapp on a container by selecting the following option in the configuration settings and selecting an appropriate container configuration:This can allow you to run the webapp on a container, scaling the available memory for the webapp. If that's not an option for you, then you are limited by the memory available on your DSS server and any cgroup limits. Batching is a good option in this case.
Thanks,
Sarina -
Hi @SarinaS
I think using a container is not necessary if you we choose the type of your instance where the WebApp is running... So maybe we can choose a huge memory type for your instance.
Is it possible to set the webapp to use all of the available memory ?