Bundle secret credentials to automation node
Hi, I've not done a release to the automation node before. My model uses APIs to connect to external data which rely on passing credentials. These credentials I have stored under my account within dataiku and using python I pass the secrets through securely.
What I am not sure on is when I bundle this model, how will the secrets be picked up, since they are currently connected to my account. Does the admin account that will run the model in automation node need to load in the same secrets for it to be picked up?
Best Answer
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,160 Neuron
This is an area Dataiku should improve. I suggest you vote on the Share Secrets proposal. As for your question indeed you will need to load the secrets on the corresponding account in the Automation node. While annoying this should be a one off setup. You could also sync/set them using the Datiku API if you prefer.
Answers
-
Cheers, have voted for this, and the workaround to access a JSON with the secrets seems to be a workaround for now. @Turribeach
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,160 Neuron
I wouldn't use a JSON file as that would have the secret unencrypted presumably. I would store them as User Secrets as these can be encrypted. The page I linked shows how to retrieve them via the Python API. You don't need to even to store them on the same user ID, it could be any user as you can impersonate them via the Python API. For obvious reasons you need to be an admin or have an admin level API key to impersonate other users.