Check out the first Dataiku 8 Deep Dive focusing on Productivity on October 29th Read More

How to access s3 files from jupyter notebook using spark or define spark's external packages

Level 2
How to access s3 files from jupyter notebook using spark or define spark's external packages

What I know is to use 




pyspark --packages com.amazonaws:aws-java-sdk:1.7.4,org.apache.hadoop:hadoop-aws:2.7.1


so that I could access s3 file, how do I configure it on dss?

0 Kudos
0 Replies
Labels (4)