-
Properly implement support for Building Flow Zones in Scenarios and the Dataiku API
In Dataiku v12.0.0 a new feature was added that allows users to build flow zones from the flow UI: https://knowledge.dataiku.com/latest/data-preparation/pipelines/tutorial-build-modes.html#build-a-flow-zone This works well however this capability was never added properly to Scenarios and to the Dataiku API. In 12.1.0…
-
Maintain case of SQL table name when creating SQL datasets
Currently, when a SQL dataset is created, the name of the associated SQL table is set to PROJECTKEY_tablename regardless of the case of the SQL dataset name. It would be great if either the case of the dataset name was maintained in the SQL table name (so dataset ABC would result in a SQL table name of PROJECTKEY_ABC…
-
Idea: Include Associated Objects When Duplicating Dataset / Flows
Hello When duplicating parts of a flow in Dataiku, the associated datasets are duplicated, but the developed charts linked to those datasets are not included. This means that users have to manually recreate or copy these charts, which can be time-consuming and prone to errors. Benefits Including the duplicate feature for…
-
Add support for Pandas 2.0
Pandas 2.0 can bring great performance improvements when using the pyarrow backend: https://towardsdatascience.com/pandas-2-0-a-game-changer-for-data-scientists-3cd281fcc4b4
-
Add option to support non-pandas dataframes (e.g. polars) in Python recipes
Hi, There are many pandas alternatives. One that is new and very fast is polars. Polars is built on Rust so it is memory safe and runs in parallel by design. I use polars in one of my recipes but have to convert it to pandas to write the dataset. thx
-
Recipe failed but notebook runs (same code environment)
My recipe failed to resolve a pip package I installed on code env. The same code runs well on Notebook area but failed on recipe using the same code env. I suspect the recipe uses old version of the code env but I have no way of forcing it to use the latest code env build. How? Operating system used: Windows Operating…
-
Warn during Project Duplication when Project Names get to Looooong....
User Story: As a Data Analyst who periodically duplicates Dataiku DSS projects, I would like to be warned if the project name gets so long that the copied project will not work reliably. This would save a bunch of time during project duplications Conditions of Satisfaction: * If the project name gets longer during…
-
In fuzzy join visual recipe add the option for strict inequality when joining columns
Background: As a data analyst that works with "dirty data" I regularly have to identify duplicate records. The Fuzzy Join visual recipe is helpful with this challenge. This will typically be done with a self join of a dataset with itself and a column or columns that represents the data items to be considered for the…
-
Flow zones and support for them in scenarios
Hello, I am exploring flow zones possibilities and I am missing one feature. Is there planned to support flow zones in scenarios? Instead of building single datasets I would like put there to build whole zone. What would be also nice is trigger another scenario when some flow zone has been refreshed. My use case: Having…
-
Default Output location for individual or Team
I would like to bring up a feature that would be very helpful for us. DSS does not default to a specific output location. it definitely would be nice if a default location like a team S3 prefix could be setup as the default output location. This would ensure our teams are using the correct output location for the majority…