Submit your innovative use case or inspiring success story to the 2023 Dataiku Frontrunner Awards! LET'S GO

Auto Scaling Snowflake Warehouse

Solved!
sj0071992
Auto Scaling Snowflake Warehouse

Hi Team,

 

Is there any way to autoscale my Snowflake Warehouse ?

Example - Some Datasets are huge which require 2X cluster of Snowflake and Some require only Small Cluster. Is there any way to auto Scale that whenever i am running my recipes?

Will EKS helps in auto scaling the the Snowflake Cluster?

Thanks in Advance 🙂

0 Kudos
1 Solution
Clément_Stenac
Dataiker

Hi,

EKS and Snowflake are two unrelated topics. No action on one will impact the other.

 

Snowflake warehouses can only auto-scale if you have the "multi-cluster warehouse" option, which requires the Enteprise edition of Snowflake https://docs.snowflake.com/en/user-guide/warehouses-multicluster.html 

If you don't have Snowflake Enterprise, you will need to contact your Snowflake representatives.

Else, the documentation mentioned above will show you how to create multi-cluster Snowflake warehouses that can autoscale. Please note that this is entirely a Snowflake-side operation. DSS does not create nor manage Snowflake warehouses.

View solution in original post

0 Kudos
2 Replies
Clément_Stenac
Dataiker

Hi,

EKS and Snowflake are two unrelated topics. No action on one will impact the other.

 

Snowflake warehouses can only auto-scale if you have the "multi-cluster warehouse" option, which requires the Enteprise edition of Snowflake https://docs.snowflake.com/en/user-guide/warehouses-multicluster.html 

If you don't have Snowflake Enterprise, you will need to contact your Snowflake representatives.

Else, the documentation mentioned above will show you how to create multi-cluster Snowflake warehouses that can autoscale. Please note that this is entirely a Snowflake-side operation. DSS does not create nor manage Snowflake warehouses.

0 Kudos
sj0071992
Author

Hi,

 

This make sense.

Thanks for the clarification 🙂

0 Kudos