How to access s3 files from jupyter notebook using spark or define spark's external packages

okiriza Registered Posts: 5 ✭✭✭✭

April 2016 edited July 16 in Setup & Configuration

What I know is to use

pyspark --packages com.amazonaws:aws-java-sdk:1.7.4,org.apache.hadoop:hadoop-aws:2.7.1

so that I could access s3 file, how do I configure it on dss?

Tagged:

• Notebooks
• Datasets
• AWS
• Cloud storage

0 · Share on FacebookShare on Twitter