-
Disk storage usage info in logs?
I am new to Dataiku, but loving the Resource Usage Monitor project that enables easy viz of compute and processing resources. However, I cannot find how to integrate storage usage into this project from the logs. I found this associated post from a few years ago which directed to use another solution other than Dataiku. Is…
-
Programmatically configuring Code env within Python Recipe for executing a scenario
Is there a way within Dataiku where we could Programmatically configuring Code env within Python Recipe for executing a scenario? This documentation doesnt' describe that functionality. Operating system used: Windows Operating system used: Windows
-
Use external server for python
Hi, Can I attach the python notebook to and environment in an external dedicated server, so it won't use Dataiku server resources? Thanks. Operating system used: Linux
-
Prod Deployment Failure - Deployment Template Issue
Hi All, We are using AKS cluster as API node to deploy our model into it. We are currently using 13.3.3. Our clusters have gate-keeper policies enabled on them and we need to add securityContext in the deployment template in order to meet the requirements. Deployment Template: apiVersion: apps/v1 # Correct API version for…
-
Dataiku DR Site - API Node
Our Current Dataiku setup in production site consists of these nodes: Design node Deployer node Automation node API node Govern node and currently we do not have DR site, and we are planning to have one.. Is it possible if in DR site, we only go for the API Node? So when the Prod site is down, API node will still up in DR…
-
ModuleNotFoundError: No module named 'modellightgbm'
I'm training a LightGBM classification model on Dataiku using a Python 3.6 environment with the following packages on dataiku 13.3.1 version : scikit-learn>=0.20,<0.21 scipy>=1.2,<1.3 xgboost==1.5.2 statsmodels>=0.10,<0.11 jinja2>=2.10,<2.11 flask>=1.0,<1.1 cloudpickle>=1.3,<1.6 matplotlib==3.3.4 numpy==1.19.5…
-
Is it possible to force communication ports between DSS and Elastic AI jobs?
I have Dataiku setup in a virtual machine using kubevirt in kubernetes. This means I am unable to open all ports between 1024-65536 since the kubevirt VM is behind a kubernetes service which doesn't allow for intervals. Does anybody have an idea how I can use a small interval of ports? (around 10) for container ←> dss…
-
How to publish from one design to multiple deployers
Hi, We are developing using a single Design node, but we want to select two or more Remote Deployers to which we will deploy our projects and APIs. The reason is that one is a Deployer in the same subnet as the Design, and the other or more are Deployers in different VPCs. We want to treat the local Deployer as for…
-
create technical users for production use-cases?
Hi, We would like to create technical users for each production use-case. These users should only have permission to run jobs related to their respective use-case, meaning we would require one technical user per use-case. However, we have dozens of use-cases in production, and creating a separate user for each one would…
-
How to connect to shared drive to extract files dynamically from there
I have a shared drive , where my input files are located, I want to extract data from those files dynamically like date wise . I need help in that to make a connection .