Registered users can ask their own questions, contribute to discussions, and be part of the Community!
I have a flow with a lot of recipes - python/SQL/SPARK & snowflake datasets, with multiple scenarios created & optimized engine used.Still my flow takes 3 hours to run & I am looking for ways to reduce this runtime, any tips & methods anyone can suggets
Operating system used: Windows
It is hard to suggest actions without looking at the specific flow, but here are some generic suggestions:
Other than this, contact your Dataiku Customer Success Manager, they can help you engage Dataiku services to optimise your flow.
I hope this helps.