Discover this year's submissions to the Dataiku Frontrunner Awards and give kudos to your favorite use cases and success stories!READ MORE

How to set-up a AWS SQS connection in Dataiku and read the streaming input to a recipe

vaishnavi
Level 2
How to set-up a AWS SQS connection in Dataiku and read the streaming input to a recipe

I want to set-up AWS SQS connection in Dataiku and read the streaming data as an input to my recipe. I read the below article

https://doc.dataiku.com/dss/latest/streaming/index.html

I did enable the "Enable Streaming" option under "Administration" section and restarted DSS.

I then tried setting up a AWS SQS connection to Dataiku DSS. I have provided the credentials and region info to connect. But when I  click on "Test" to test the connection, it says "Connection to SQS failed: Unable to execute HTTP request: Connection reset, caused by: SocketException: Connection reset"

 

Please help me with below queries:

1. How to set-up AWS SQS connection in Dataiku successfully ?

2. How to read the SQS messages as input to my recipe ?

0 Kudos
1 Reply
CatalinaS
Dataiker
Dataiker

To set-up AWS SQS connection in DSS you indeed need to provide AWS key pair and the region of the  Amazon SQS. The error message that you are getting indicates a networking issue.

How to read the SQS messages is explained here Reading from SQS endpoints.

0 Kudos