data checks based on validation data
danf101
Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 4 Partner
A common scenario is to validate new incoming data quality based on statistics calculated as metrics over an older/original/validation data set. If the dropdown checks over data metrics could include an option to validate in relation to previously calculated metrics on a different data set - that would solve this.
see:
for a code implementation of the idea
Comments
-
Elie Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Product Ideas Manager Posts: 32 DataikerVery interesting ! Thanks for your idea @danf101
. Your idea meets the criteria for submission, we'll reach out should we require more information.
Feel free to leave a comment in the discussion about how this capability would help you or your team.
Take care,
Elie