Logging metrics

[ben_p]

Hi everyone,

I am running SQL recipes that create datasets in DataIKU, on occasion I need to troubleshoot the output of these and I am interested in seeing metrics such as row count, trended over time.

I could write another SQL recipe that looks out the output dataset and creates another, but I wondered if there was a way to leverage the inbuilt in Status > Metrics to store them over time and present them in a dashboard?

Ben

[AlexT · Accepted solution]

Hi @ben_p ,

You can use the history of the dataset metrics in DSS. Metrics are added to the history when computed.

You can retrieve these :

- in the Flow +Dataset > Internal > Metrics , choose the  Dataset/s.

- Python APIs

- Dashboards, You can directly publish metrics history to a dashboard as well + Metrics , choose the dataset and the metrics and you can display the history or last value 

Hope that helps!