file-based partitioning - add the "week" granularity in dataiku's time dimension
Dataiku provides the option for partitioning data based on time, but currently it is limited to four granularities:
- year
- month
- day
- hour
It would be beneficial to have a "week" granularity available as well.
This would be particularly useful for companies, like ours, that process data in weekly batches. Having a time dimension that aligns with this time pattern would allow for launching batches on corresponding dataset partitions, making data processing more efficient and aligned with business needs.
cc : @ElieA
Comments
-
Elie Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered, Product Ideas Manager Posts: 32 Dataiker
Thanks for submitting this idea and for sharing the context around why it would be useful to your team.
You'll be pleased to hear this idea is in our backlog. It is a request we've received from customers--and we are determining the next steps for development.
We can't provide a timeline at this point, but be sure to check back for updates! For everyone else, kudos the original post to signal that you're interested in Dataiku developing and releasing this feature!
Take careElie
-
Seems like voting is the new kudos, so I did that instead. Would be a big help depending on the raw data.