How to access s3 files from jupyter notebook using spark or define spark's external packages

Registered Posts: 5 ✭✭✭✭
edited July 2024 in Setup & Configuration

What I know is to use


pyspark --packages com.amazonaws:aws-java-sdk:1.7.4,org.apache.hadoop:hadoop-aws:2.7.1

so that I could access s3 file, how do I configure it on dss?

Welcome!

It looks like you're new here. Sign in or register to get started.

Welcome!

It looks like you're new here. Sign in or register to get started.