Dataiku flow documentation

Alpha
Alpha Registered Posts: 5 ✭✭✭✭

From the Flow documentation, there are values for Datasets (total size and record count). How do I add more datasets metrics such as Min, Max, Std Dev, etc into the documentation? Hope that someone can share the specific steps. If there are samples, it will be much appreciated.

Tagged:

Answers

  • LouisDHulst
    LouisDHulst Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Neuron, Registered, Neuron 2023 Posts: 55 Neuron

    Hi @Alpha ,

    Sounds like you're talking about about Dataset Metrics. You can follow the concept guide to learn more about them. Depending on your DSS version you might also want to look at Data Quality rules (DSS 12.6 and above) or Checks (12.5 and below).

    For examples you can refer to the Data Quality & Automation academy course or use the Data Quality tutorial project (when you create a new project, choose the tutorial option).

  • Alpha
    Alpha Registered Posts: 5 ✭✭✭✭
    edited August 2024

    hi @LouisDHulst , if I use Datasets metrics for column statistics, how do I add these metrics to the flow documentation? I am assuming I have to do this via Scenario custom trigger? Can you provide a custom script sample?

Setup Info
    Tags
      Help me…