Run glue job from python recipe in dataiku
Options
goku
Registered Posts: 16 ✭
How to run glue job from python recipe in dataiku either by uising boto3 or other method. When using boto3 getting client error when calling StartJobRun operation: the security token included in the request is invalid.
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,209 DataikerOptionsHI @goku
The error you shared suggests your credentials require MFA and may have not session tokenYou need to set the session token, access, and secret key.
https://aws.amazon.com/premiumsupport/knowledge-center/authenticate-mfa-cli/
https://boto3.amazonaws.com/v1/documentation/api/latest/reference/core/session.html#module-boto3.sessionAnother option is to generate access key and secret that doesn't require MFA.
Thanks