faster approach for a container

agerami Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 3 ✭✭✭

Hi Gurus,

When I run program on a machine, for getting meta data from big files, it is rather fast, when I make it as a plugin, it is slow.

Any idea how I can overcome this problem?

it is approximately 20 second vs 22 minutes.




  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,727 Neuron

    Hi, you will need to give us a lot more information on what exactly you are doing for us to be able to help. Please post your code and where you think the time is being spent. Add some logging to your code to determine what parts of your code are slow.

Setup Info
      Help me…