faster approach for a container

agerami
agerami Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 3 ✭✭✭

Hi Gurus,

When I run program on a machine, for getting meta data from big files, it is rather fast, when I make it as a plugin, it is slow.

Any idea how I can overcome this problem?

it is approximately 20 second vs 22 minutes.

Regards

Arshia

Answers

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,981 Neuron

    Hi, you will need to give us a lot more information on what exactly you are doing for us to be able to help. Please post your code and where you think the time is being spent. Add some logging to your code to determine what parts of your code are slow.

Setup Info
    Tags
      Help me…