Dataiku offers the ability to add custom metrics and checks which is very useful for testing the flow.
However, some checks can be improperly defined or break for whatever reason. In this case, dataiku ignores the check, and the flow can be built without the user being notified of a problem. This is a silent error: the check fails but no error is raised.
Here is a demo showing this problem:
the user has a custom python check containing an error (the check fails)
the check is supposed to run at each build on the table (e.g. the following option is checked)
and yet, when the table is built, no errors is raised: the user is not notified of the problem on the check potentially (and more importantly) on the table
It would be appreciated if dataiku could raise an error in this case (which, from what I know, is the default behaviour of common testing frameworks).