-
automatically remove obsolete versions of code envs on Automation Nodes
This product idea addresses the issue discussed here: Remove old versioned environments and kernels after importing a bundle. Recently, we faced an issue with one of our automation nodes. New deployments were failing because there was no space left on disk. Upon investigation, we discovered that a code environment was…
-
PYSPARK_PYTHON environment variable issue in PySpark
Hi I am facing below issue for PySpark recipe. Exception: Python in worker has different version 2.7 than that in driver 3.6, PySpark cannot run with different minor versions.Please check environment variables PYSPARK_PYTHON and PYSPARK_DRIVER_PYTHON are correctly set. I have set the environment variables using…
-
Advanced container settings for R code environments
Like the Python code environments can have dockerfiles defined to be applied when building code env we need the same for R. We find our self modifying the base DSS image to accommodate some features needed in an R code environment.
-
Practical Use of Code Studios
I am starting this thread to learn about how others are using code studios (such as VSCode, JupyterLab, and Streamlit) and for what purposes. In our organization, we were initially excited about the feature introduced in DSS v11. However, our enthusiasm was quickly dampened by the fact that users cannot select the…
-
Create a code environment manager module
Hi, My group has dozens of code environments and use various Python packages. It would be great if Dataiku had a dedicated module that would allow the user to specify a python package and get the current version in each code environment for the code environments I have access to. Second, it would be great if I could push a…
-
Using darts python library to create a custom Saved Model
I've followed the tutorial here: Importing serialized scikit-learn pipelines as Saved Models for MLOps - Dataiku Developer Guide and I've been able to develop a model using the darts==0.30.0 library, having wrapped it in the standard scikit-learn pipeline. My issue is with the very last part of step 3 of this tutorial…
-
Default project key is not specified (no DKU_CURRENT_PROJECT_KEY in env)
I'm creating a python function endpoint with this script: And I don't know how to deal with this error: Dev server deployment FAILED Failed to initiate function server : <class 'Exception'> : Default project key is not specified (no DKU_CURRENT_PROJECT_KEY in env)
-
Managing Code Environment Permissions: Hiding a Code Environment from Other Users
We have numerous code environments on our Dataiku platform, making it cumbersome to select a specific environment in a notebook from an endless list (see the following image). We attempted to remove a code environment from this list by unchecking the option "Usable by all" (see the following image). However, unchecking…
-
cannot install osgeo
Hello community, I can't install the python library osgeo in a code env. Ã Encountered error while trying to install package. â°â> osgeo note: This is an issue with the package mentioned above, not pip. Do you have any solutions ?
-
allow users to upgrade the python interpreter in their code env
We have hundreds of Python code environments, known as "code envs", within our Dataiku design instance. Our objective is to clean and upgrade these environments. However, Dataiku users have restricted rights that prevent them from altering the Python interpreter. This imposes a challenge due to 'end of life' Python…