Can't set up "Containerized execution", "Build image for containerized visual recipes" not working

tihobbes

I have a GCP / Ubuntu installation of DSS. I'm trying to set up GKE to run recipes on. I've used the GKE plugin to create a cluster, I can see it running (both from DSS and from the Google Cloud Console). I think the documentation is outdated and refers to an older version of the plugin and still relies on the Google Container Registry instead of the Artifact Registry.
The help (for instance here https://doc.dataiku.com/dss/latest/containers/gke/managed.html#create-base-images) talks about clicking a button "push base images". I can't find that button anywhere, however there's a button "build image for containerized recipes", I assume I need to do this ? This fails though :
ERROR: failed to solve: dku-cde-base-pwh0vc74qslagcj7ktvoozkz:dss-13.4.0: failed to resolve source metadata for docker.io/library/dku-cde-base-pwh0vc74qslagcj7ktvoozkz:dss-13.4.0: pull access denied, repository does not exist or may require authorization: server message: insufficient_scope: authorization failed

I saw online that docker gives this error even when it's not an actual authorization issue… So basically when I ssh into the machine I can use docker, I can pull the hello-world etc. In the doc they talk about building the base images through one of their scripts (https://doc.dataiku.com/dss/latest/containers/setup-k8s.html#k8s-base-image), I've done that, but that image is built and place in tmp. So I've tried to tag it and push so it matches what the DSS "build" button is trying to pull. I was able to push from the command line but still that button doesn't seem to work. I've check all permissions, roles, users/service accounts, I can't figure out what's wrong. Has anyone gone through this before ?

Operating system used: ubuntu (20.04)

tihobbes

OK for anyone who finds this later, I didn't figure out how to use that "Build image for containerized visual recipes" so I built the image myself using the command from the documentation, and then I tagged and pushed it myself to the artifact repository. Then, using the "Test on <mycluster>" button, I could see that it worked. I was later able to use my cluster to run python recipes etc. I think that button is meant to build, tag, push automatically but I couldn't get it to cooperate :)

Turribeach

It’s a bug, fixed in 13.4.1:

https://doc.dataiku.com/dss/latest/release_notes/13.html#elastic-ai

tihobbes

Thanks a lot !