Can't use Spark on prepare recipes ("Cannot use optimized engine: disabled in global settings")

Benoni
Benoni Registered Posts: 23 ✭✭✭✭
edited June 2024 in Using Dataiku

Hi again,

I can run PySpark just fine. (e.g. copy a dataset). However i cant use the Spark engine on prepare recipes. How can i fix the following error?

I have Spark enabled in my settings.

Thanks in advance

Best Answer

  • Mattsco
    Mattsco Dataiker, Registered Posts: 125 Dataiker
    edited June 2024 Answer ✓

    Hi,



    You can find this setting in Administration, Settings, Spark:


    Matt

Answers

Setup Info
    Tags
      Help me…