Dataiku offers the ability to add custom metrics and checks which is very useful for testing the flow.
However, some checks can be improperly defined or break for whatever reason. In this case, dataiku ignores the check, and the flow can be built without the user being notified of a problem. This is a silent error: the check fails but no error is raised.
Here is a demo showing this problem:
- the user has a custom python check containing an error (the check fails)
It would be appreciated if dataiku could raise an error in this case (which, from what I know, is the default behaviour of common testing frameworks).