Calculate a single metric/check via the Dataiku API

Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,389 Neuron
edited July 2024 in Product Ideas
1
1 votes

Released · Last Updated

As mentioned in the comment below, as of 12.6.0, you can now compute a singular Data Quality rule (and it's underlying metric) via the python API.

However, no change has been made to the metrics API, so if you wanted to compute a metric that is not associated with a DQ rule, you'd still need to compute all at once. If you are interested in computing metrics one at a time via the python API, please submit another product idea so we can track that separately.

Hi,

It is currently not possible to calculate a single metric or check via the Dataiku API while this is possible via the GUI. The following APIs exists:

dataset.compute_metrics()
dataset.run_checks()

but they will calculate all enabled metrics/checks which may take a lot of time. So this idea is to provide an API to allow running a single metric or a single check. Thanks

Welcome!

It looks like you're new here. Sign in or register to get started.

Comments

  • Dataiker, Registered, Product Ideas Manager Posts: 110 Dataiker

    Thanks for the feedback @Turribeach
    ! Acknowledging receipt and we will let you know here if we move forward with development.

    Katie

  • Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 15 Partner

    Hi @Katie !
    Has it been implemented, taken into account in the roadmap, or not yet ?
    Best regards,
    Moaï

  • Dataiker, Registered, Product Ideas Manager Posts: 110 Dataiker

    Hi @Aymeric

    Thanks for following up, yes, you can now compute a singular Data Quality rule (and it's underlying metric) via the python API, see documentation here: Site faviconData Quality

    However, no change has been made to the metrics API, so if you wanted to compute a metric that is not associated with a DQ rule, you'd still need to compute all at once.

    I'm going to mark this product idea as delivered, as it seems the goal was more around checks/rules. If, however, you are still interested in computing metrics one at a time via the python API, please submit another product idea so we can track that separately.

    Katie

  • Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,389 Neuron

    Thatr's great Katie, that indeed is what we were after! In which version exactly was this new functionality added?

  • Dataiker, Registered, Product Ideas Manager Posts: 110 Dataiker

    @Turribeach apologies for the delay, if you havent already sorted it out, it was released in 12.6.0 :)

Welcome!

It looks like you're new here. Sign in or register to get started.

Welcome!

It looks like you're new here. Sign in or register to get started.