Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
automatically remove obsolete versions of code envs on Automation Nodes
Added on November 27, 2024 5:52PM
Likes: 3
Replies: 1
Tanguy
Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Dataiku DSS Developer, Neuron 2023 Posts: 135 Neuron
This product idea addresses the issue discussed here: Remove old versioned environments and kernels after importing a bundle.
Recently, we faced an issue with one of our automation nodes. New deployments were failing because there was no space left on disk. Upon investigation, we discovered that a code environment was occupying over 100 GB due to multiple versions linked to the bundles previously deployed on the instance.
After deleting some bundles, we expected the obsolete versions of the code environment to be removed automatically. However, this was not the case.
This feature proposal suggests enabling DSS to automatically delete obsolete versions of a code environment when the associated bundles are removed.
Comments
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,371 NeuronMakes sense and gets my vote but doesn't remove the need to do capacity management and proactive monitoring in your Dataiku instances.