Implement automatic computation of Record Counts at project level

Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Dataiku DSS Developer, Neuron 2023 Posts: 129 Neuron
6
6 votes

New · Last Updated

This proposal is the natural progression of the discussion in this thread. Introducing automatic computation of record counts during the construction of each dataset would greatly benefit users who need to monitor dataset volumes over time. Specifically, a sudden drop or sharp increase in record counts often indicates issues within the data pipeline that require investigation. Manually enabling record count computation for each dataset is tedious, which is why this product idea suggests automating this feature for all datasets at the project level.

Comments

  • Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,607 Neuron

    As I was thinking about this I was thinking about the data count flow view. And needing to choose the auto recompute the count of record option every time I create a dataset. I’d like to set the option that @tanguy
    is proposing and have that value set for every new dataset in a project.

Welcome!

It looks like you're new here. Sign in or register to get started.

Welcome!

It looks like you're new here. Sign in or register to get started.