No module named pyspark.sql in Jupyter

UserBird Dataiker, Alpha Tester Posts: 535 Dataiker

March 2017 in Setup & Configuration

While trying to run the sample code provided in the Jupyter Python Spark Notebook, I get an error "no module named pyspark.sql" :

Do I need to configure something in order to use pyspark ?

I'm running DSS community on an EC2 AMI.

Tagged:

• Notebooks
• Spark

0 · Share on FacebookShare on Twitter

Best Answer

• 

  Clément_Stenac Dataiker, Dataiku DSS Core Designer, Registered Posts: 753 Dataiker

  March 2017 Answer ✓

  Hi,
  
  You need to setup the DSS / Spark integration.
  
  * For DSS 3.1: https://doc.dataiku.com/dss/3.1/installation/spark.html
  
  * For DSS 4: https://doc.dataiku.com/dss/latest/spark/installation.html

  0 · Share on FacebookShare on Twitter