Auto Scaling Snowflake Warehouse

Options
sj0071992
sj0071992 Partner, Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Dataiku DSS Developer, Neuron 2022, Neuron 2023 Posts: 131 Neuron

Hi Team,

Is there any way to autoscale my Snowflake Warehouse ?

Example - Some Datasets are huge which require 2X cluster of Snowflake and Some require only Small Cluster. Is there any way to auto Scale that whenever i am running my recipes?

Will EKS helps in auto scaling the the Snowflake Cluster?

Thanks in Advance

Best Answer

  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer Posts: 753 Dataiker
    Answer ✓
    Options

    Hi,

    EKS and Snowflake are two unrelated topics. No action on one will impact the other.

    Snowflake warehouses can only auto-scale if you have the "multi-cluster warehouse" option, which requires the Enteprise edition of Snowflake https://docs.snowflake.com/en/user-guide/warehouses-multicluster.html

    If you don't have Snowflake Enterprise, you will need to contact your Snowflake representatives.

    Else, the documentation mentioned above will show you how to create multi-cluster Snowflake warehouses that can autoscale. Please note that this is entirely a Snowflake-side operation. DSS does not create nor manage Snowflake warehouses.

Answers

Setup Info
    Tags
      Help me…