-
Problem using python recipe
I have a problem when using a python recipe that uses the kubernetes engine when running. I checked the log step by step, the python process should have been completed, but for some reason the kubernetes engine does not show a sign of completion and looks like an unfinished loop. Please help with this error.
-
Can't set up "Containerized execution", "Build image for containerized visual recipes" not working
I have a GCP / Ubuntu installation of DSS. I'm trying to set up GKE to run recipes on. I've used the GKE plugin to create a cluster, I can see it running (both from DSS and from the Google Cloud Console). I think the documentation is outdated and refers to an older version of the plugin and still relies on the Google…
-
Dataiku K8S Pod unable to connect DSS
[urllib3.connectionpool] http://XXXXX:PORT "POST /dip/api/XXXXX/containers/get-execution HTTP/1.1" 500 None [ERROR] [root] Could not reach DSS: None: b'Unknown execution context: test_execution_id Pod config have the necessary variables under the container along with the base image. This execution id is returning as…
-
Feature request for next release
Experimenting with the new kubernetes stuff in Dataiku, nice stuff. Would be nice if you (as an admin) could have a gui for the build of the base images in DSS itself.
-
How does Dataiku handle scheduling of containers
Hi, Say i have a Dataiku pipeline and there are 3 nodes running in parallel in the pipeline. Each node is performing some actions that requires a GPU each, this node is performed by submitting as a container job to Kubernetes cluster. Now while the nodes are initializing, one of them gets a FailedScheduling from Kubernetes…
-
Spark on Kubernetes
In Install guide, it talks about Spark on Hadoop-YARN. Does DataIKU support spark on kubernetes cluster? if yes, then is hadoop install required? . Please link any doc or article in this matter if available.