-
Passing Previous Month Partition to workflow recipes
In the scenario build, there is an option for selecting time partitions. This works great, but I want to know how to pass this variable to recipes such as a python and sql recipe. I wasn't able to make this work until I looked at the log and saw this variable '$DKU_DST_YEAR_MONTH', this appears to work, but I don't know if…
-
as_core_knowledge_bank not working on dataiku-api-client==14.2.3
To convert a DSSKnowledgeBank to a KnowledgeBank using the dataiku API we have to use the as_core_knowledge_bank() function (https://developer.dataiku.com/latest/tutorials/genai/nlp/create-knowledge-bank/index.html). However, the instantiation of the KnowledgeBank is not working because the context_project_key is missing…
-
MLOps best practices for Dataiku
Hi, I am investigating Dataiku, but I am struggling with integrating default DevOps workflows with Dataiku. What are the best practices in integrating the following CICD principles in a Dataiku environment? - code linting (e.g. with pylint, black), ensuring code adheres to code standards. - unit tests (e.g. with pytest),…
-
How to "send" a knowledge bank with a get_llm?
Hello all, Here our context : -An headless custom web app on Dataiku that receives through API a user question and must give an answer based on internal procedures -as of today, the procedures are sent in markdown with the prompt but it's really heavy and the response time is more thant 20 seconds -I have played with…
-
How to get the list of items of default zone using python?
This is my code and 'Data Pool' is my default zone and it has more hen 10 tables but it is not fetching the list of items for default zone. however it is working for other zones but not for this default zone. Operating system used: Windows Operating system used: Windows
-
When importing datasets with columns stored as int, DSS seems to want to store them as double.
Using wip_discrete_jobs as an example we have columns that should be integers but are ingested as numeric. For example, Table: wip_discrete_jobs Column: wip_entity_id Type: numeric(38,15) If I query the table SELECT wip_entity_id, organization_id FROM khw_eng.wip_discrete_jobs WHERE wip_entity_id = 34922 The result is as…
-
Scenario Variables
Hi. I created a scenario. In step 1, I read the parameters sent over the webapp API using get_trigger_params and set_scenario_variables - the next step is to run the recipe. I would like to know how to read the set scenario variables within the recipe scope so that parallel runs on the scenario execute smoothly. Since they…
-
Hive table updated but not updated in dataiku accordingly
HI All, I am a green hand using dataiku. currently I have 1.created dataset from Hive 2.create dashboard from #1 while Source dataset in #1 has a) add new fields & b) refreshed value. in #2 dashboard, not see any changes. My question is how to update these changes in #2? Operating system used: windows Operating system…
-
What does (NP) mean?
I ran a recipe twice where the first run had (NP) in the job run details and the second run did not have (NP) in the job name. What does this mean and what can be causing this difference?
-
How to use a remote MCP server tool in Dataiku
Is there a doc about how to do this in a recipe or notebook? I have created an MCP server following the tutorial here: Building your MCP Server in Dataiku - Dataiku Developer Guide I have tested this via MCP Inspector. Now I'd like to see how I can test this or an external MCP server from a Dataiku project. The "wrapping…
