Implement automatic computation of Record Counts at project level

Options
Tanguy
Tanguy Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Dataiku DSS Developer, Neuron 2023 Posts: 112 Neuron

This proposal is the natural progression of the discussion in this thread. Introducing automatic computation of record counts during the construction of each dataset would greatly benefit users who need to monitor dataset volumes over time. Specifically, a sudden drop or sharp increase in record counts often indicates issues within the data pipeline that require investigation. Manually enabling record count computation for each dataset is tedious, which is why this product idea suggests automating this feature for all datasets at the project level.

5
5 votes

New · Last Updated

Comments

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,595 Neuron
    Options

    As I was thinking about this I was thinking about the data count flow view. And needing to choose the auto recompute the count of record option every time I create a dataset. I’d like to set the option that @tanguy
    is proposing and have that value set for every new dataset in a project.

Setup Info
    Tags
      Help me…