Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
I have a flow with a lot of recipes - python/SQL/SPARK & snowflake datasets, with multiple scenarios created & optimized engine used.
Still my flow takes 3 hours to run & I am looking for ways to reduce this runtime, any tips & methods anyone can suggets
Operating system used: Windows
Hi,
It is hard to suggest actions without looking at the specific flow, but here are some generic suggestions:
Other than this, contact your Dataiku Customer Success Manager, they can help you engage Dataiku services to optimise your flow.
I hope this helps.
Best regards