-
getting error while importing dataiku project.
while i am migrating dev to val, getting the below error. canyou please provide me with how can i fix it. Importing archive... Traceback (most recent call last): File "/app/dss_install/dataiku-dss-13.2.2/python/dataikuapi/dssclient.py", line 1490, in _perform_http response.raise_for_status() File…
-
MS SQL SERVER CONNECTION
Hello Everyone, I created a connection with my Azure SQL DB using the MS SQL Server connector, the connection went well, but when I clicked on get table list, I got the following error message: Oops: an unexpected error occurred The connection is closed. Please see our options for getting help HTTP code: 500, type:…
-
Seeking Optimization Tips for DSS Flow and Spark Configuration
hello everyone, I am currently working on optimizing my DSS flow. I have a scenario that currently takes 20 minutes to execute, and I am looking to reduce this time to just 5 minutes. I would greatly appreciate any tips or strategies for optimization. Additionally, I am interested in understanding how to configure Spark…
-
Spark Configuration for optimization resource allocation
Hello, I am interested in understanding how to configure Spark settings to ensure optimal resource allocation. Specifically, I am looking for guidance on configuring parameters like spark.driver.cores, spark.dynamicAllocation.initialExecutors, spark.executor.cores, spark.dynamicAllocation.enabled, spark.executor.instances,…
-
Dynamic Column
I have an excel input file. Col A to Col T till row T26, I have data where Col T have latest month data. Col V to Col AO have second set of data till AO50. Now, its dynamic data, every month, a new column is added. For example, for next month, Col u will have Dec month's data. same with second set of data, I will be…
-
Delete records based on multiple JOINs
Newbie here. Trying to convert a SQL from HIVE that pulls records partly based on several JOIN conditions but limits those record based on other JOIN conditions. In SQL it is a "WHERE NOT EXISTS" condition. The following is the code - SELECT x FROM y, z Multiple left joins… (and) WHERE NOT EXISTS ( SELECT 1 FROM…
-
Error with instance of APP111ParametersAnalyzer
Hello, I try to create an instance of APP111ParametersAnalyzer, but when I did that I have this problem. "Invalid connection for dataset product_database_prepared_filtered : filesystem_managed (Filesystem) is not freely usable and needs to be remapped." Do you know how I can fixe this issue? Operating system used: Data IKU…
-
Use a Recipe filter where value is NULL
How do I identify a record where the value in a specific field is NULL, in a Recipe filter condition?
-
Cant figure out how to match predictions with customers.
Hi all, dataiku novice here. I have trained models in python notebooks with mlflow, then I deployed a model to the flow(from experiment tracking) in order to score & evaluate it. I have 50 features, and when I input the feature table with 50 columns into the scoring recipe, everything is fine and i get my predictions. The…
-
Does anyone know how to add a RecordID column in dataiku. I want to add serial number to each row.
