Discover this year's submissions to the Dataiku Frontrunner Awards and give kudos to your favorite use cases and success stories!READ MORE

Partitioning based on minutes or seconds

KevinHart
Level 2
Partitioning based on minutes or seconds

Hi All,

I want to use partitioning for folders with the following syntax:

/partition_date=20220907235959

I tried to create a partitioning pattern, however I am only able to create a pattern on hour, not on minutes or seconds. Therefore I created the following pattern:

/partition_date=%Y%M%D%H.*/.*

When I try to list the partitions everything works, see screenshot.

However when I try to run my standard filter recipe I am getting the error that the path does not exist (same screenshot)

I think this has to do with the .* in the partitioning pattern, does anyone have any idea why this issue occurs?


Operating system used: Windows


Operating system used: Windows

0 Kudos
0 Replies