-
Dataset Left Anti Join - issue with decimals
Hi all, I have two datasets that are similar in their structure and my goal is to get a dataset that has records of the left table that do not have a match in the right table and as a result, I used Left Anti Join. I am matching the tables on a number of keys and one of those keys is a column which is of type decimal…
-
Why are projects and API endpoints not showing up in the Unified Monitoring?
We have API endpoints and projects set up in the automation node, but they are not showing up in the Unified Monitoring. Things I did to try to add the API Endpoints and Projects to the monitoring: * Projects:* Deployed a new project to the automation node * API:* Set up event server * Set up the automation node as an…
-
How to change string/text data type to double/decimal throughout a build?
Hi all! This the following scenario on a build: I have a dataset D1 pulling in data from a SharePoint folder with several CSV files. One of the columns in the D1 dataset has decimal numbers which contains a % symbol. Dataiku reads it as a string/text data type. If I change the data type to double/decimal - all the data in…
-
Schema evolution: CSVs with varying headers
When creating a dataset from a list of csv files, dataiku detects the schema of the first file (or can be overridden with the schema of one manually selected file). I have collections of files where the schema slightly changes over time: * New columns are added * Some columns are removed * Some columns change position With…
-
Scenario failing when accessing SFTP
Hello ! I have an issue with a scenario when trying to access a SFTP. When I run the notebook it's working fine, but the scenario throws this error everytime (both manual and automatic run) : Error while connecting to dataset <my_dataset> (partition 2023-12-21), caused by: IOException: SSH error connecting to <my_sftp>,…
-
do a scored survey
I have long excel sheet, I want to create something like an application that goes through each row and create a question that is read from one row and show the other options. based on the answer of the user, it is scores number in the cell in its related row and column, afterwards create a final some after the survey/ quiz…
-
Join recipe by date issue
I have datasets with timestamp columns in CET/CEST and I parse those to UTC. So far, so good. But when I try to join those datasets by date, using those parsed date, I get unexpected matches. Here is a minimal (non)-working example. Dataset A: date = [2020-10-25T02:00:00+02:00, 2020-10-25T02:00:00+01:00], value = [1.0,…
-
Use a list as variable in SQL Query
Hello everyone, I need your help in using a list as project variable in a SQL query. I have a dataset with a list on numbers, with a custom python recipe, I stored the numbers as list in my variable project. It's looking like this : { "liste": [ 12265378, 9122915, 12292085, 12514810001, 12241211, 12262172, 4624440] } I now…
-
Python process failed during building knowledge bank
I am trying to build a knowledge bank with PDF docs(about 2pages) using OpenAI embedding model ADA-002. I am using the visual recipes (text splitter) which runs succesfully. But while running the the embedding recipe(build knowledge bank) I am getting this error msg Oops: an unexpected error occurred The Python process…
-
Error type:net.snowflake.client.jdbc.SnowflakeSQLException
SQL compilation error: syntax error line 4 at position 0 unexpected 'INSERT'. You may need to ask your DSS administrator to check logs for additional information Additional technical details * Error type:net.snowflake.client.jdbc.SnowflakeSQLException Operating system used: Windows
