Make project variables available in SQL Probe Metrics

Marlan
Marlan Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Dataiku Frontrunner Awards 2021 Participant, Neuron 2023 Posts: 320 Neuron

SQL probe metrics along with associated checks that compare characteristics of the current table with other tables can be important validation steps.

It is possible to write probes that reference other tables in a project. However, since project variables are not accessible the table names must be hard coded rather than using the DSS feature that enables referencing tables via variables (e.g., ${projectKey}_tablename) so that the resolved table names are automatically unique across projects.

Not having this functionality means when projects are copied (e.g., for others on the team to work on) such probes either fail or give misleading results (by referencing a table from a previous project). Or alternatively we don't write such probes even when they would be useful to avoid the extra work of fixing problems and the risk of forgetting to make table name changes.

The request then is to be able use project variables in a SQL probe.

3
3 votes

Released · Last Updated

Comments

  • Mark_Treveil
    Mark_Treveil Dataiker Alumni Posts: 30 ✭✭✭✭✭

    Marlan

    Thanks for the request. This is already logged in our feature backlog and is slated for development in the near future.

    Mark

  • Marlan
    Marlan Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Dataiku Frontrunner Awards 2021 Participant, Neuron 2023 Posts: 320 Neuron

    @Mark_Treveil
    , that's great to hear!

    Thanks!

    Marlan

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,598 Neuron

    Thanks, this is working for me.

Setup Info
    Tags
      Help me…