Using Dataiku
Sort by:
1 - 10 of
34
- Hello, As we are using Spark heavily, we are having the problem of slowness of application launching in yarn cluster mode. The slowness comes from having many DSS related files and also many jars file…
Last answer by AlexandruHi,
I believe this has been discussed directly with your Dataiku Account team. There is currently no way to run in cluster mode and running in cluster would not make it faster as the same Jars would still need to be loaded. - Hi all ,, I need to use the sparkSql and spark for python I installed the spark and it shown in the administration settings . but when I run the sparkSQL it raised this error Cannot run program "spark…
Last answer by CatalinaHi,
This issue usually occurs when spark integration was not re-run after a recent upgrade and it can't find spark-submit.
Please re-run spark integration using the standalone archive downloaded from Dataiku DSS download site for your DSS version:
You can run spark integration with the following command using the version of your DSS version:
/data/bin/dssadmin install-spark-integration -standaloneArchive PATH_TO/dataiku-dss-spark-standalone-12.2.0-3.4.1-generic-hadoop3.tar.gz
This is explained here Setup Spark.
1 - 10 of
341