Discover this year's submissions to the Dataiku Frontrunner Awards and give kudos to your favorite use cases and success stories!READ MORE

Logging metrics

Solved!
ben_p
Neuron
Neuron
Logging metrics

Hi everyone,

I am running SQL recipes that create datasets in DataIKU, on occasion I need to troubleshoot the output of these and I am interested in seeing metrics such as row count, trended over time.

I could write another SQL recipe that looks out the output dataset and creates another, but I wondered if there was a way to leverage the inbuilt in Status > Metrics to store them over time and present them in a dashboard?

Ben

0 Kudos
1 Solution
AlexT
Dataiker
Dataiker

Hi @ben_p ,

You can use the history of the dataset metrics in DSS. Metrics are added to the history when computed.

You can retrieve these :

- in the Flow +Dataset > Internal > Metrics , choose the  Dataset/s.

- Python APIs

- Dashboards, You can directly publish metrics history to a dashboard as well + Metrics , choose the dataset and the metrics and you can display the history or last value 

Screenshot 2022-03-23 at 12.40.38.png

Hope that helps!

View solution in original post

1 Reply
AlexT
Dataiker
Dataiker

Hi @ben_p ,

You can use the history of the dataset metrics in DSS. Metrics are added to the history when computed.

You can retrieve these :

- in the Flow +Dataset > Internal > Metrics , choose the  Dataset/s.

- Python APIs

- Dashboards, You can directly publish metrics history to a dashboard as well + Metrics , choose the dataset and the metrics and you can display the history or last value 

Screenshot 2022-03-23 at 12.40.38.png

Hope that helps!