Spark installation in standalone mode in DSS

Paulami

Hi, Our Dataiku is not connected to Hadoop or Kubernetes cluster. Can I still install spark in local DSS server?

Turribeach

Yes, this can be done but it is not a recommended setup. The documentation covers the use of an unmanaged Spark on Kubernetes:

https://doc.dataiku.com/dss/latest/spark/installation.html

https://doc.dataiku.com/dss/latest/spark/configuration.html

You do need to install the Spark standalone binary:

https://doc.dataiku.com/dss/latest/containers/setup-k8s.html#optional-setup-spark

https://downloads.dataiku.com/public/studio/13.3.1/dataiku-dss-spark-standalone-13.3.1-3.4.1-generic-hadoop3.tar.gz

Paulami

Thank you so much! Let me try these and I will come back to you.