Discover this year's submissions to the Dataiku Frontrunner Awards and give kudos to your favorite use cases and success stories!READ MORE

data checks based on validation data

 A common scenario is to validate new incoming data quality based on statistics calculated as metrics over an older/original/validation data set. If the dropdown checks over data metrics could include an option to validate in relation to previously calculated metrics on a different data set - that would solve this.

see:

https://community.dataiku.com/t5/Using-Dataiku/Recommend-Way-for-Comparing-Metrics-between-Multiple-...

for a code implementation of the idea

1 Comment
ElieA
Dataiker
Dataiker
Status changed to: Acknowledged

Very interesting ! Thanks for your idea @danf101 . Your idea meets the criteria for submission, we'll reach out should we require more information.

Feel free to leave a comment in the discussion about how this capability would help you or your team.

Take care,


Elie