SQL connection pooling feature

Barthelemy

Hello,

I am using a Dash web app for an internal tool to read/write data to a Snowflake connection. This web app may have up to 20-30 concurrent users, and I am noticing that a fresh connection is opened everytime a query to Snowflake is made. This creates intense connection overhead, leading to slower response times in the app. This could potentially be solved by pooling the connections together. Is this a feature that Dataiku supports?

Endpoint	Calls	Avg	Max
sql-queries/start-streaming	83	773 ms	2,752 ms
datasets/read-data	21	1,685 ms	2,531 ms
sql-queries/stream (just data transfer)	66	77 ms	666 ms

Dataiku version used: 14.0

Turribeach

No, Dataiku doesn't support connection pooling but I agree it really should. You can raise a Product Idea request. Your only solution will be to implement connection pooling yourself inside of your webapp.