-
Read files in managed folders with shell
Hi, can someone help me please. Given a folder input and a folder output I want to link them with a shell script so that the shell script can read a test.txt file from input folder and write the output.txt file in the output folder with a .sh script but when i use the variables of dataiku it doesn't work. Here an example…
-
Use a Recipe filter where value is NULL
How do I identify a record where the value in a specific field is NULL, in a Recipe filter condition?
-
space character handling in Dataiku dataset
Hi, I have a Greenplum database table as an input for my dataset, let's name this as gp_tableA. From this dataset, I have a Prepare recipe, we name it as compute_gp_tableA_prepared. I only use this recipe to rename some columns and remove unwanted ones. I notice at the output dataset (gp_tableA_prepared), one of the…
-
dataiku failed to load data from snowflake(large dataset)
Exception: Reading dataset failed: failed to read data from table, caused by: SnowfalkeSQLLoggedException: JDBC driver internal error: Timeout waiting for the download of #chunk0(Total chunks: 79)
-
Decimal format
Hello, I would like to round the numbers of my datasets with only 1 or 2 decimals. Does someone know how to do it easily ? Thanks in advance !
-
How to use "Execute Python unit test" scenario step
A new scenario step was added in a recent DSS version which is to execute a Python unit test. I'd like to start using this. However, the documentation is pretty brief: "this step executes one or more Python pytest tests from a project’s Libraries folder using a Pytest selector". Anyone have more details on or an example of…
-
Why are SQL queries in Dataiku slower than in my AWS Docker container (RDS Oracle)?
Hello, I'm currently using Dataiku and SQLExecutor2 to run queries on my Oracle database hosted on AWS RDS, port 2484. When I execute the same query from a Docker container on AWS, the query takes about 15 ms. However, when I run it in Dataiku, it takes approximately 1 second, and the whole process, which takes about 8…
-
Dataiku CSV output saves all data in one column
Hi everyone, I'm facing an issue while writing a CSV file to S3 using a Sync Recipe in Dataiku. Even though the dataset looks correct inside Dataiku, when it gets saved to S3, all the data appears in one single column instead of being properly separated into multiple columns. I checked the dataset schema, and everything…
-
Dashboard error only running from a Scenario
I have a scenario that builds and exports a Dashboard and survived several Dataiku version upgrades until now. When the scenario runs I have a Reporter that exports the Dashboard into a PDFs and sends an email. Since the upgrade to 12.6.7, that Reporter fails to run and I get the following message "Domain contains control…
-
Cant figure out how to match predictions with customers.
Hi all, dataiku novice here. I have trained models in python notebooks with mlflow, then I deployed a model to the flow(from experiment tracking) in order to score & evaluate it. I have 50 features, and when I input the feature table with 50 columns into the scoring recipe, everything is fine and i get my predictions. The…
