-
Extract ID out of a column
Hello , I'm trying to extract the numbers after the / (but it's not always the first / ) and it's not the end of the url... In exemple i only want the Bold number /33988-329055 I though an extract would work but it doesn't... Could anyone knows why ? Thanks
-
Add users and grant permissions via dataikuapi for Projects
hi Team, Do we have any programmatic way to add and grant permissions to users for projects via dataikuapi? (i.e) project.add_users via dataikuapi? project.get_permissions()['permissions'] Thanks, Thiagu
-
Remove columns by pattern
Lets say I want to remove all the columns that contain the word "Spot" in them. How would I do that. I cannot figure out the syntax for Remove columns matching.
-
How to import a plugin after a dataiku instance change
hello, I initally had a devlopped plugin available in a specific Dataiku instance. We had to change the dataiku instance . Is there an easy way to reload or import this previous plugin in this new instance? Thank you
-
On opening/loading, python notebook gives Out of Memory error
Hi, When I try to open a python notebook, screen freezes after couple of seconds and finally throws error saying "Out of Memory". Any suggestions to resolve this issue is appreciated. Thanks. Regards, AJ
-
ELT best practices? (workspace, intermediate data sets, views...)
We are preparing a SAS to Databricks migration and we are considering Dataiku as a low-code ETL for non-technical users. Dataiku feels very close to an awesome experience but there are a few issues that make me worry about the sustainability of such an approach. Do you have recommended best practices to mitigate those…
-
Elasticsearch index with custom settings?
Hi community! I am wondering how I can create an Elasticsearch index with custom settings for the analyzer, filter and tokenizer. The documentation (doc.dataiku.com/dss/latest/connecting/elasticsearch.html) mentions "you can use an index template before building the managed dataset for the first time", however, it does not…
-
SqlExecutor2 does not handle Snowflake ARRAY data type * Bug?
Hello, I am using the SQLExecutor2 to read a temporary table and write to a Snowflake dataset in a Python recipe. Here is the column data type: {"type":"ARRAY","length":16777216,"byteLength":16777216,"nullable":true,"fixed":false} Here is my Python code: Expression type does not match column data type, expecting…
-
Using SQLExecutor2 inside shared library
Hi, I would like to execute some raw sql queries like insert the rows directly into the oracle database. Based on the various community discussions, I chose to use SQLExecutor2. My code is as below: from dataiku import SQLExecutor2 import dataiku def test(): # get the needed data to prepare the query # for example, load…
-
How to use LLM Mesh work with LiteLLM
Hi, I'm working on an Agentic Gen AI project using the crewai package, which uses LiteLLM as the engine to connect to various Gen AI models. I would like to use Dataiku LLM Mesh, but it seems that it's not compatible with the LiteLLM. I tried to use the DKULLM and DKUChatLLM, but both of them are not working. I'm on…