Survey banner
Switching to Dataiku - a new area to help users who are transitioning from other tools and diving into Dataiku! CHECK IT OUT

Auto Scaling Snowflake Warehouse

Solved!
sj0071992
Auto Scaling Snowflake Warehouse

Hi Team,

 

Is there any way to autoscale my Snowflake Warehouse ?

Example - Some Datasets are huge which require 2X cluster of Snowflake and Some require only Small Cluster. Is there any way to auto Scale that whenever i am running my recipes?

Will EKS helps in auto scaling the the Snowflake Cluster?

Thanks in Advance ๐Ÿ™‚

0 Kudos
1 Solution
Clรฉment_Stenac

Hi,

EKS and Snowflake are two unrelated topics. No action on one will impact the other.

 

Snowflake warehouses can only auto-scale if you have the "multi-cluster warehouse" option, which requires the Enteprise edition of Snowflake https://docs.snowflake.com/en/user-guide/warehouses-multicluster.html 

If you don't have Snowflake Enterprise, you will need to contact your Snowflake representatives.

Else, the documentation mentioned above will show you how to create multi-cluster Snowflake warehouses that can autoscale. Please note that this is entirely a Snowflake-side operation. DSS does not create nor manage Snowflake warehouses.

View solution in original post

0 Kudos
2 Replies
Clรฉment_Stenac

Hi,

EKS and Snowflake are two unrelated topics. No action on one will impact the other.

 

Snowflake warehouses can only auto-scale if you have the "multi-cluster warehouse" option, which requires the Enteprise edition of Snowflake https://docs.snowflake.com/en/user-guide/warehouses-multicluster.html 

If you don't have Snowflake Enterprise, you will need to contact your Snowflake representatives.

Else, the documentation mentioned above will show you how to create multi-cluster Snowflake warehouses that can autoscale. Please note that this is entirely a Snowflake-side operation. DSS does not create nor manage Snowflake warehouses.

0 Kudos
sj0071992
Author

Hi,

 

This make sense.

Thanks for the clarification ๐Ÿ™‚

0 Kudos