Announcing the winners & finalists of the Dataiku Frontrunner Awards 2021! Read their inspiring stories

Auto Scaling Snowflake Warehouse

Solved!
sj0071992
Level 2
Level 2
Auto Scaling Snowflake Warehouse

Hi Team,

 

Is there any way to autoscale my Snowflake Warehouse ?

Example - Some Datasets are huge which require 2X cluster of Snowflake and Some require only Small Cluster. Is there any way to auto Scale that whenever i am running my recipes?

Will EKS helps in auto scaling the the Snowflake Cluster?

Thanks in Advance 🙂

0 Kudos
1 Solution
Clément_Stenac
Dataiker
Dataiker

Hi,

EKS and Snowflake are two unrelated topics. No action on one will impact the other.

 

Snowflake warehouses can only auto-scale if you have the "multi-cluster warehouse" option, which requires the Enteprise edition of Snowflake https://docs.snowflake.com/en/user-guide/warehouses-multicluster.html 

If you don't have Snowflake Enterprise, you will need to contact your Snowflake representatives.

Else, the documentation mentioned above will show you how to create multi-cluster Snowflake warehouses that can autoscale. Please note that this is entirely a Snowflake-side operation. DSS does not create nor manage Snowflake warehouses.

View solution in original post

0 Kudos
2 Replies
Clément_Stenac
Dataiker
Dataiker

Hi,

EKS and Snowflake are two unrelated topics. No action on one will impact the other.

 

Snowflake warehouses can only auto-scale if you have the "multi-cluster warehouse" option, which requires the Enteprise edition of Snowflake https://docs.snowflake.com/en/user-guide/warehouses-multicluster.html 

If you don't have Snowflake Enterprise, you will need to contact your Snowflake representatives.

Else, the documentation mentioned above will show you how to create multi-cluster Snowflake warehouses that can autoscale. Please note that this is entirely a Snowflake-side operation. DSS does not create nor manage Snowflake warehouses.

View solution in original post

0 Kudos
sj0071992
Level 2
Level 2
Author

Hi,

 

This make sense.

Thanks for the clarification 🙂

0 Kudos
A banner prompting to get Dataiku DSS