User S3 Connection in Pyton/R Recipe

Solved!
raviagrawal
Level 3
User S3 Connection in Pyton/R Recipe

Hi,

Dataiku provide capability to use the SQL connection defined in dataiku admin to be utilized in python or R recipe 

https://doc.dataiku.com/dss/latest/python-api/sql.html

Is there any similar capability is available with S3 connection too ?

Regards,

Ravi Agrawal

 

1 Solution
ATsao
Dataiker

Hi Ravi,

SQLExecutor2 is meant to enable executing SQL queries against a database through Python directly. As S3 is not a relational database, this wouldn't really apply to S3. 

If you wish to connect to S3 through a Python or R recipe, you can simply the appropriate S3 dataset as an input for your code recipe and then use/read it as a dataframe. More information about how to do this in Python or R can be found in our documentation here:

https://doc.dataiku.com/dss/latest/code_recipes/python.html#using-pandas

https://doc.dataiku.com/dss/latest/code_recipes/r.html#reading-a-dataset-in-a-dataframe

I hope that this helps!

Thanks,

Andrew

View solution in original post

1 Reply
ATsao
Dataiker

Hi Ravi,

SQLExecutor2 is meant to enable executing SQL queries against a database through Python directly. As S3 is not a relational database, this wouldn't really apply to S3. 

If you wish to connect to S3 through a Python or R recipe, you can simply the appropriate S3 dataset as an input for your code recipe and then use/read it as a dataframe. More information about how to do this in Python or R can be found in our documentation here:

https://doc.dataiku.com/dss/latest/code_recipes/python.html#using-pandas

https://doc.dataiku.com/dss/latest/code_recipes/r.html#reading-a-dataset-in-a-dataframe

I hope that this helps!

Thanks,

Andrew