A common scenario is to validate new incoming data quality based on statistics calculated as metrics over an older/original/validation data set. If the dropdown checks over data metrics could include an option to validate in relation to previously calculated metrics on a different data set - that would solve this.
see:
https://community.dataiku.com/t5/Using-Dataiku/Recommend-Way-for-Comparing-Metrics-between-Multiple-...
for a code implementation of the idea