Auto Scaling Snowflake Warehouse
Hi Team,
Is there any way to autoscale my Snowflake Warehouse ?
Example - Some Datasets are huge which require 2X cluster of Snowflake and Some require only Small Cluster. Is there any way to auto Scale that whenever i am running my recipes?
Will EKS helps in auto scaling the the Snowflake Cluster?
Thanks in Advance
Best Answer
-
Hi,
EKS and Snowflake are two unrelated topics. No action on one will impact the other.
Snowflake warehouses can only auto-scale if you have the "multi-cluster warehouse" option, which requires the Enteprise edition of Snowflake https://docs.snowflake.com/en/user-guide/warehouses-multicluster.html
If you don't have Snowflake Enterprise, you will need to contact your Snowflake representatives.
Else, the documentation mentioned above will show you how to create multi-cluster Snowflake warehouses that can autoscale. Please note that this is entirely a Snowflake-side operation. DSS does not create nor manage Snowflake warehouses.
Answers
-
sj0071992 Partner, Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Dataiku DSS Developer, Neuron 2022, Neuron 2023 Posts: 131 Neuron
Hi,
This make sense.
Thanks for the clarification