Dataiku flow documentation
From the Flow documentation, there are values for Datasets (total size and record count). How do I add more datasets metrics such as Min, Max, Std Dev, etc into the documentation? Hope that someone can share the specific steps. If there are samples, it will be much appreciated.
Answers
-
LouisDHulst Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Neuron, Registered, Neuron 2023 Posts: 53 NeuronHi @Alpha ,
Sounds like you're talking about about Dataset Metrics. You can follow the concept guide to learn more about them. Depending on your DSS version you might also want to look at Data Quality rules (DSS 12.6 and above) or Checks (12.5 and below).
For examples you can refer to the Data Quality & Automation academy course or use the Data Quality tutorial project (when you create a new project, choose the tutorial option).
-
hi @LouisDHulst , if I use Datasets metrics for column statistics, how do I add these metrics to the flow documentation? I am assuming I have to do this via Scenario custom trigger? Can you provide a custom script sample?