-
Dataiku remove duplicate data
Hi all in dataiku after doing a left join operation I am removing all the duplicate values, but when I exported the dataset as an excel I noticed there are few rows which are exactly matching but are not removed or considered duplicate. Once I did the TRIM operation in excel then duplicate values were considered and…
-
Problem using python recipe
I have a problem when using a python recipe that uses the kubernetes engine when running. I checked the log step by step, the python process should have been completed, but for some reason the kubernetes engine does not show a sign of completion and looks like an unfinished loop. Please help with this error.
-
How to reproduce a groupBy with selected values without aggregations ?
SELECT DISTINCT N1.COLUMN1 as "Column 1", max(N1.COLUMN2) as "Column 2" FROM DB GROUP BY N1.COLUMN1 ORDER BY N1.COLUMN1 Hello, I'm trying to reproduce an sql script with Dataiku recipes, and in that script, there is a groupBy with selected columns with no aggregation, how do I reproduce this with Dataiku recipes and…
-
Batch Processing for Custom API end point
I’ve developed a custom Python API endpoint for regression and successfully predicted outcomes for individual records. However, when I attempt to process a batch of records, I encounter the following error: "Failed: Could not parse a SinglePredictionQuery from request body, caused by: JsonSyntaxException: Expected a…
-
Create API from visual RAG
I'm using visual recipes to create a simple RAG system. Can I create API from my RAG set up? Operating system used: Linux
-
Default content for project description
Hello DataIKU friends, I would like to enforce better documentation standard across our DSS project, one way I would like to do this is by having a "template" project description which each author completes, which follows a sec structure. is it possible to give DSS a default value for the "description" field when a new…
-
How to Parse XML Values in a Column Using Dataiku Visual Recipe (Preparation Recipe)?
Hello everyone, I am trying to parse XML values within a column of a Dataiku dataset using a visual recipe (preparation recipe) in Dataiku. For JSON values, I can use processors like "Unnest Object (Flatten JSON)" to extract and structure the data. However, I couldn't find a similar built-in processor for handling XML…
-
Issue with Dataiku Visual Recipe Failing to Save Data to SQL Database
Hello, I am currently using an Other SQL Database connection in Dataiku and utilizing Visual Recipes to save data to a table. In some cases, such as when uploading files or handling simple datasets, the table is successfully created and saved. However, there are instances where the process fails. I would like to understand…
-
Stock geometry / geopoint objects on Hive
Hello everyone, I would like to store a column of type geometry or geopoint in my HDFS dataset with the aim of later performing a geojoin recipe between a geometry column containing polygons and a geopoint column containing geopoints. When I try to store my column in geopoint format, I get the following error: And when I…
-
my pivote recipe is giving me an empty table
hi i have a project that was working fine ,but since i took this project to automation env some of my recipe in dev env and automation env are returning empty it important to know that the dev and automation env are running on the same production database (my hadoop datasource)
