-
Sending Custom Email Notification for Empty Datasets in Dataiku Scenario
Hi everyone, I have a scenario in Dataiku where I am running step by step one flow and there I need to check four datasets. If any of them are empty, I want to send a custom email notification to users mentioning which datasets are empty. Additionally, the process should continue only if at least two datasets have…
-
Issues with Importing Excel file
Hi everyone, I'm currently uploading an Excel dataset into Dataiku. When I select "single datasheet," some Excel files are importing all of my columns correctly, but others are not. Can anyone explain why this might be happening and suggest how I can fix it? I am looking for a dynamic solution using Python, so the input…
-
How can I change the default location where a .conf file is created to any custom location?
Hello Community, I am using the great expectations package in a dss project for my Data Quality checks. I have already installed it in my code env and using it in a python script for the time being. Even though, the package properly runs in a python notebook when I save it back to recipe I get the following error: " Job…
-
RAG Webapp
Hello everyone, In my Dataiku Flow, I have a RAG setup that includes embeddings and prompts. I’d like to replicate this process—achieving the same results as in Prompt Studio—in a Dash web app. The goal is to reuse the knowledge base built in the Flow and leverage the augmented LLM created by the embedding recipe. Does…
-
getting error while importing dataiku project.
while i am migrating dev to val, getting the below error. canyou please provide me with how can i fix it. Importing archive... Traceback (most recent call last): File "/app/dss_install/dataiku-dss-13.2.2/python/dataikuapi/dssclient.py", line 1490, in _perform_http response.raise_for_status() File…
-
MS SQL SERVER CONNECTION
Hello Everyone, I created a connection with my Azure SQL DB using the MS SQL Server connector, the connection went well, but when I clicked on get table list, I got the following error message: Oops: an unexpected error occurred The connection is closed. Please see our options for getting help HTTP code: 500, type:…
-
column Index
I have a dataset which has Jan, Jan_1, Feb, Feb_1... I was to use Column index to pick the last column. Can you help using Column index without Python?
-
Access to webapp back-ends from outside of DSS (with Postman)
I found this article but i have some questions, hope someone can help me. I created a standard webapp with python server, im trying to access the endpoints from postman. I'm sending my project apikey as suggested by documentation but I'm receving this message: <body> <h1 style="margin-top: 50px">HTTP error 401 (Not…
-
Seeking Optimization Tips for DSS Flow and Spark Configuration
hello everyone, I am currently working on optimizing my DSS flow. I have a scenario that currently takes 20 minutes to execute, and I am looking to reduce this time to just 5 minutes. I would greatly appreciate any tips or strategies for optimization. Additionally, I am interested in understanding how to configure Spark…
-
Spark Configuration for optimization resource allocation
Hello, I am interested in understanding how to configure Spark settings to ensure optimal resource allocation. Specifically, I am looking for guidance on configuring parameters like spark.driver.cores, spark.dynamicAllocation.initialExecutors, spark.executor.cores, spark.dynamicAllocation.enabled, spark.executor.instances,…
