-
Batch Processing for Custom API end point
I’ve developed a custom Python API endpoint for regression and successfully predicted outcomes for individual records. However, when I attempt to process a batch of records, I encounter the following error: "Failed: Could not parse a SinglePredictionQuery from request body, caused by: JsonSyntaxException: Expected a…
-
Create API from visual RAG
I'm using visual recipes to create a simple RAG system. Can I create API from my RAG set up? Operating system used: Linux
-
The recipe execution is taking long time due to handling a large volume of data in dataiku
We are experiencing long execution times for a recipe in Dataiku due to handing large datasets, while we have implemented partitioning using a filter on a specific column, it still takes 1.5-2 hours to partitioning 30M records. Is there a more efficient way to handle and process this data quickly and effectively because…
-
Default content for project description
Hello DataIKU friends, I would like to enforce better documentation standard across our DSS project, one way I would like to do this is by having a "template" project description which each author completes, which follows a sec structure. is it possible to give DSS a default value for the "description" field when a new…
-
How to Parse XML Values in a Column Using Dataiku Visual Recipe (Preparation Recipe)?
Hello everyone, I am trying to parse XML values within a column of a Dataiku dataset using a visual recipe (preparation recipe) in Dataiku. For JSON values, I can use processors like "Unnest Object (Flatten JSON)" to extract and structure the data. However, I couldn't find a similar built-in processor for handling XML…
-
Issue with Dataiku Visual Recipe Failing to Save Data to SQL Database
Hello, I am currently using an Other SQL Database connection in Dataiku and utilizing Visual Recipes to save data to a table. In some cases, such as when uploading files or handling simple datasets, the table is successfully created and saved. However, there are instances where the process fails. I would like to understand…
-
Stock geometry / geopoint objects on Hive
Hello everyone, I would like to store a column of type geometry or geopoint in my HDFS dataset with the aim of later performing a geojoin recipe between a geometry column containing polygons and a geopoint column containing geopoints. When I try to store my column in geopoint format, I get the following error: And when I…
-
my pivote recipe is giving me an empty table
hi i have a project that was working fine ,but since i took this project to automation env some of my recipe in dev env and automation env are returning empty it important to know that the dev and automation env are running on the same production database (my hadoop datasource)
-
R Code Experiment Tracking
How can I do experiment tracking for a model based on R code/recipe. The documentation here: https://doc.dataiku.com/dss/latest/mlops/experiment-tracking/tracking.html only describes this scenario for python code. My DSS version is actually 13 Operating system used: macOS Operating system used: macOS
-
Object not serializable error on an if then else statement run on spark engine
I get the following error when I run an if then else error on spark. This runs fine on the local engine. I have if then else statements that run just fine in other sections of my workflow in the DSS. How should I interpret this and how do I debug? Job failed: Task not serializable, caused by:…
