How to set-up a AWS SQS connection in Dataiku and read the streaming input to a recipe

vaishnavi

I want to set-up AWS SQS connection in Dataiku and read the streaming data as an input to my recipe. I read the below article

https://doc.dataiku.com/dss/latest/streaming/index.html

I did enable the "Enable Streaming" option under "Administration" section and restarted DSS.

I then tried setting up a AWS SQS connection to Dataiku DSS. I have provided the credentials and region info to connect. But when I click on "Test" to test the connection, it says "Connection to SQS failed: Unable to execute HTTP request: Connection reset, caused by: SocketException: Connection reset"

Please help me with below queries:

1. How to set-up AWS SQS connection in Dataiku successfully ?

2. How to read the SQS messages as input to my recipe ?

Catalina

To set-up AWS SQS connection in DSS you indeed need to provide AWS key pair and the region of the Amazon SQS. The error message that you are getting indicates a networking issue.

How to read the SQS messages is explained here Reading from SQS endpoints.