Fleetmanager add schedule to Start / Stop of Instances in Cloud time based

Daria_E
Daria_E Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1 ✭✭✭✭

We use Dataiku in AWS with Instances (Design, Deployer, Automation). The first three month all instances where running 24/7 in the cloud. To reduce our cost we have created managed tags on each instance called start_time and stop_time.

Setup: In the cloud (AWS Lambda) we created a function that reads the current time and checks if an instance is running. The function starts or stops the instance if the current time is between start_time and stop_time. A job executes the function every 5 min.

We were able to reduce out AWS costs by 50% compared to the first 3 month. Our design node does now run Monday - Friday 7:00 to 21:00, for Deployer and Automation node we have set different start and stop times. I believe that every customer could use this kind of feature in their cloud, if it was available through fleet manager.

@GerritH

8
8 votes

New · Last Updated

Comments

  • rmoore
    rmoore Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Participant, Neuron 2023 Posts: 33 Neuron

    BIG upvote for this feature - great job @GerritH

  • Caroline
    Caroline Registered, Dataiku Frontrunner Awards 2021 Participant Posts: 4 ✭✭✭✭

    Voting for this feature as well !

Setup Info
    Tags
      Help me…