Change recipe default engine
Hi all,
I'm wondering if there's a way to change the recipe default engine from DSS to Spark as I'm using S3 datasets. I know it can be done for a specific recipe by clicking the icon below the Run button, but I want to change it for the whole project.
Thanks in advance!
Best Answer
-
RoyE Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 31 DataikerHello!
This can be done within the Project Settings -> "Engines & Connections'. See screenshot provided.
By setting your default engine to SPARK, all your existing and newly created recipes that allow a Spark engine, will be defaulted to Spark. There also exists options to set preferred engine by recipes in the following settings.
Hope this helps!
Roy
Answers
-
Yeah, great! It works. Thank you very much!!
-
PK36313 Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 10 PartnerHi @RoyE
Could you please tell me where can I find Project Settings -> "Engines & Connections'.
Do I required admin access for changing Engines & ConnectionsThanks in Advance.
-
The accepted solution didn't work for me when I wanted to change the engine for existing recipes. Here's what I did: clicked on "recipes" in the top-left corner of the Flow screen and then selected Change Engine in the right sidebar.
