Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Hi, I'm trying to run some spark code in scala in a Notebook.
When selecting Scala(Spark) in the notebook window, it shows me this modal : Kernel not found - I couldn't find a kernel matching Spark-Scala.
I think that Spark is configured as I can successfully use it in recipes.
From this page (https://doc.dataiku.com/dss/latest/spark/usage.html), I saw that The Spark-Scala notebook requires DSS to be run with Java 8.
So I ssh'ed to the EC2 machine running DSS and from the bottom of this page (https://doc.dataiku.com/dss/latest/installation/java_env.html) I see that we can set the DKUJAVABIN variable to point to the Java8 bin folder thanks to the command $ DKUJAVABIN=/usr/local/bin/java dataiku-dss-VERSION/installer.sh <INSTALLER_OPTIONS>
My question is : Is this the correct way to make the Scala-Spark notebook working ?
And : Will this command reinstall DSS and remove the work I've done in the previous installation ?
Thanks for your help !