Limited batch problem

ik007
ik007 Registered Posts: 4 ✭✭✭

I am using a webapp to label some images, but the problem is it can only load a batch of 400 images at once, if I try to increase the batch size to 700 or 1000 or greater the webapp crashes.

Could you please tell how can I make the webapp handle 1000 or more than 1000 images batch

Thank you

Answers

  • Sarina
    Sarina Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 317 Dataiker

    Hi @ik007
    ,

    If you have a Kubernetes cluster available, you can run the webapp on a container by selecting the following option in the configuration settings and selecting an appropriate container configuration:

    Screen Shot 2022-09-29 at 2.48.06 PM.png

    This can allow you to run the webapp on a container, scaling the available memory for the webapp. If that's not an option for you, then you are limited by the memory available on your DSS server and any cgroup limits. Batching is a good option in this case.

    Thanks,
    Sarina 

  • ik007
    ik007 Registered Posts: 4 ✭✭✭

    Hi @SarinaS

    I think using a container is not necessary if you we choose the type of your instance where the WebApp is running... So maybe we can choose a huge memory type for your instance.

    Is it possible to set the webapp to use all of the available memory ?

Setup Info
    Tags
      Help me…