automatically remove obsolete versions of code envs on Automation Nodes

Tanguy
Tanguy Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Dataiku DSS Developer, Neuron 2023 Posts: 119 Neuron

This product idea addresses the issue discussed here: Remove old versioned environments and kernels after importing a bundle.

Recently, we faced an issue with one of our automation nodes. New deployments were failing because there was no space left on disk. Upon investigation, we discovered that a code environment was occupying over 100 GB due to multiple versions linked to the bundles previously deployed on the instance.

After deleting some bundles, we expected the obsolete versions of the code environment to be removed automatically. However, this was not the case.

This feature proposal suggests enabling DSS to automatically delete obsolete versions of a code environment when the associated bundles are removed.

2
2 votes

New · Last Updated

Comments

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,115 Neuron

    Makes sense and gets my vote but doesn't remove the need to do capacity management and proactive monitoring in your Dataiku instances.

Setup Info
    Tags
      Help me…