Plugins & Extending Dataiku
-
LLM Batch requests
I am experiencing rate limit errors for my LLM requests. Is there a simple method to batch my requests? My thanks in advance. Tom Operating system used: Mac OS
-
Way to store certificate and key securely without using folder
Hi ! Our plugin needs certificate and key(types of which is not supported as dataiku dataset) for authentication purpose to fetch the data . I'm giving these by creating a folder in a secure location(using project connection, macros) and attaching it to plugin as input and specifying in UI the file names it should look for…
-
My custom Plugin changes are not applied.
My environment is Dataiku built on-premise AWS. I created my custom Plugin from a Python program recipe. I edited and saved the recipe.json of this Plugin, but when I invoke the Plugin in the flow screen, the changes are not applied. I then restarted Dataiku and all the changes were applied. How can I apply the changes to…
-
Assistance with Integrating YOLOv5 in Dataiku
Hello Dataiku Community, I'm currently working on a project where I need to use the YOLOv5 algorithm to detect potholes in images. I have a dataset with labeled images ready, and I’m trying to set up YOLOv5 within a Dataiku Python recipe for model training. However, I’ve encountered several issues along the way, and I’m…
-
Exporting a file in dynamic name
Hi, I have my output as "Final_output" at the end of the flow. I want to export this into S3 as a csv with the name "Final_output_$datetime.csv" So everytime the flow runs, it has to create a file with that timestamp. I tried with variable. But didnt work when it comes to file name creation. Thanks, Vinothkumar M
-
Sharepoint Online Plugin
Looking for assistance with Sharepoint List Views. Anytime I try to bring in a view that I have created and saved in Sharepoint, the plugin doesn't respect the columns that are in my view. As a quick example, I created a view off of a default list that only has three columns, and the plugin pulls in some default set of…
-
Error in python process: <class 'ValueError'>: Numeric feature score_2 is empty
Trying to run a Recommendation system, I received this error not allowing to run the job. Received this error message, checked the database and all fields are with information. [01:16:18] [INFO] [dku.utils] - *************** Recipe code failed **************[01:16:18] [INFO] [dku.utils] - Begin Python stack[01:16:18]…
-
Running Python code in Library from Dataiku Application
Hi! I am interested in understanding if it is possible to call a Python script in a Library that I linked with my GitHub, and call a module within that script to run it on a Dataiku Application. In other words, how do you call a Python script defined in a Project Library to the interface below which is defined in the…
-
Understanding dataiku.runnables functions : utils.make_unique_project_key
Greetings ! In the documentation, there is en example function for create project key when we create a new project : # The project creation macro must create the project. Therefore, it must first assign # a unique project key. This helper makes this easy project_key = utils.make_unique_project_key(user_client,…
-
External data catalog integration
Hi everyone, I'm looking for a way to integrate DataIku into a standalone Data Catalog tool. For example, DataHub. This stems from the fact that some initial data load and transformation happens inside the DWH through orchestration tool like Airflow and transformation tool like dbt. This creates initial datasets that are…
