I get random errors on my Kafka due to GCS bucket failures and Bigquery size limits. I'm working with my teams to resolve, but I'm wanting to know if there is an easy way to restart a continuous process in the event of a failure? I thought about setting a scenario to start the process every 30 minutes or so, but I'm sure…
I am trying to create an ML application which can display the various types of transformations that happen in a dataset, like the count of certain rows, their min, max, etc. This app will take data from the flow and display whatever information is needed for the particular run. I need a way to pass the information to this…
I have a similar question to the one posted a few years ago https://community.dataiku.com/t5/General-Discussion/Python-script-to-export-any-kind-of-recipes-into-SQL/m-p/21298 I have a flow with tons of recipes. I want to convert that into "a" code, python, SQL, pyspark... I do not care. The solution in the link works only…
I want to read a docx file in my dataiku folder through python recipes, but it returns permission denied. How can I change my folder access permissions? PermissionError: [Errno 13] Permission denied: '/data/dataiku/dss_data/managed_folders/TUMING/DYV5ukXU/GDMS005_001.docx'
Hi, Is there any functionality similar to MLflow within Dataiku ? Regards, Varun
Hey everyone! Currently I am using the prepare recipe, and specifically the Create if, then, else statements processor. For one of the if statements, I want to write an if statement that check if each value in a specific column is not contained in a given array. I know that I can compare a value with another value;…
Hi all, I have a question regarding custom python models for a clustering modelling task. I am trying to do something really basic, like running Agglomerative Clustering using a different metric and linkage methods (included in sklearn natively). at the moment, I seem to be unable to do so default model in dataiku, so I…
Hi, I created an application recipe in project A, which I want to use in project B. This recipe requires multiple parameters as input. In project B, these parameters are defined in my variables. As the application recipe does not allow for a reference to these variables, I try to find a work around for this. I initially…
Is there any way to setup a connection that connects to a locally running LLM? On Apple Silicon it is possible to run huggingface models locally with some different open source solutions, which make use of Metal for the GPU-compute. The solution I have running can be said to function as a server accessible as localhost.…
Hi all. New to Dataiku and shiny but facing an issue where my app is not being populated with column names as you can see in the attached screenshot. The app without any filtering applied that just prints the head of the data works. The log is fine Loading required package: shiny Listening on http://127.0.0.1:6288 UI:…
Create an account to contribute great content, engage with others, and show your appreciation.
