Import S3 file in Dataiku notebooks

dasrana007
dasrana007 Registered Posts: 2 ✭✭✭

Hi,

I am currently trying to read a csv file from S3 bucket in AWS. I am using the native python3 notebook in Dataiku.

I am trying to use boto3 module. Is there any other recommendation to read S3 bucket files in native Python?

regards,

Rana

Answers

  • fchataigner2
    fchataigner2 Dataiker Posts: 355 Dataiker

    Hi,

    for direct access to the files from python, boto is the way to go. If you only need to read the data, you can also use the usual APIs to have DSS read the files for you: create a S3 connection in the administration settings, create a dataset pointing to the files, and in python do a `dataiku.Dataset("the dataset name").get_dataframe()`

Setup Info
    Tags
      Help me…