How to access s3 files from jupyter notebook using spark or define spark's external packages

okiriza
okiriza Registered Posts: 5 ✭✭✭✭
edited July 16 in Setup & Configuration

What I know is to use


pyspark --packages com.amazonaws:aws-java-sdk:1.7.4,org.apache.hadoop:hadoop-aws:2.7.1

so that I could access s3 file, how do I configure it on dss?

Setup Info
    Tags
      Help me…