-
Properly implement support for Building Flow Zones in Scenarios and the Dataiku API
In Dataiku v12.0.0 a new feature was added that allows users to build flow zones from the flow UI: https://knowledge.dataiku.com/latest/data-preparation/pipelines/tutorial-build-modes.html#build-a-flow-zone This works well however this capability was never added properly to Scenarios and to the Dataiku API. In 12.1.0…
-
Calculate a single metric/check via the Dataiku API
Hi, It is currently not possible to calculate a single metric or check via the Dataiku API while this is possible via the GUI. The following APIs exists: dataset.compute_metrics() dataset.run_checks() but they will calculate all enabled metrics/checks which may take a lot of time. So this idea is to provide an API to allow…
-
Select which test queries to run in API Designer
Often times when testing and adjusting test queries, I only want a single query to be executed. It would be helpful to have selection boxes next to the test queries in API Designer for which queries to (re-)run when using the Run testqueries command.
-
Invalid Scenario step logic condition should cause scenario failure
I have noted a very dangerous behavior in the latest v12 release although I believe this has been in DSS for a long while. DSS will not cause a scenario failure or even a warning if you have an invalid Scenario step logic. For instance I created a scenario step and set two variables: {"var1": 123, "var2": 456} Then I…
-
Being able to set User Settings via Python API
There are now more user settings than ever in the user's profile page (DSS/profile/). In v12.3.2 there are now 10 different email notification settings. We would like to be able to customise these to our preferred defaults via the Dataiku Python API. Currently the Dataiku Python API does not support this. Thanks
-
Add support for Pandas 2.0
Pandas 2.0 can bring great performance improvements when using the pyarrow backend: https://towardsdatascience.com/pandas-2-0-a-game-changer-for-data-scientists-3cd281fcc4b4
-
Move objects and Zones on the Flow
I think it would be very useful to be able to move objects and flow zones around in the flow display. It appears Dataiku determines where each recipe, dataset, etc go in the flow and I cannot edit that. I have used Alteryx in the past and it had that ability, which I liked. It allows me to organize the flow however I see…
-
Prevent deletion of objects that are used in Scenarios
The stability of our workloads is very important to us. We now have significant dependencies in our Dataiku platform so we are very sensitive to any changes that can impact our scheduled scenarios. After being burnt multiple times we have identified a series of user actions that can result in scenarios failing without the…
-
Add test button for SQL query change and Custom trigger scenario triggers
Users love the flexibility of having SQL query change and custom trigger (Python) scenario triggers. However these two types of triggers involve custom user code and they are not easy to test since the user would need to either wait for Dataiku to execute them and check the logs or take the SQL / Python code outside of the…
-
Add support for Quarto
Just like Rmarkdown reports are supported, I'd like to suggest support for quarto. Rmarkdown is a great tool to create dynamic reports that can be refreshed daily, but it lacks a good integration with python. Having quarto available will help several of our analysts to create reports without having to learn R.