file-based partitioning - add the "week" granularity in dataiku's time dimension

Tanguy
Tanguy Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Dataiku DSS Developer, Neuron 2023 Posts: 120 Neuron

Dataiku provides the option for partitioning data based on time, but currently it is limited to four granularities:

  1. year
  2. month
  3. day
  4. hour

It would be beneficial to have a "week" granularity available as well.

This would be particularly useful for companies, like ours, that process data in weekly batches. Having a time dimension that aligns with this time pattern would allow for launching batches on corresponding dataset partitions, making data processing more efficient and aligned with business needs.

cc : @ElieA

2
2 votes

In the Backlog · Last Updated

Comments

  • Elie
    Elie Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Product Ideas Manager Posts: 32 Dataiker

    Thanks for submitting this idea and for sharing the context around why it would be useful to your team.

    You'll be pleased to hear this idea is in our backlog. It is a request we've received from customers--and we are determining the next steps for development.

    We can't provide a timeline at this point, but be sure to check back for updates! For everyone else, kudos the original post to signal that you're interested in Dataiku developing and releasing this feature!

    Take care

    Elie

  • ebbingcasa
    ebbingcasa Registered Posts: 24 ✭✭✭✭✭

    Seems like voting is the new kudos, so I did that instead. Would be a big help depending on the raw data.

Setup Info
    Tags
      Help me…