Submit your innovative use case or inspiring success story to the 2023 Dataiku Frontrunner Awards! LET'S GO

How can I add today date for new input ?

Dmh911
Level 1
How can I add today date for new input ?

Hello, 

I have an input dataset coming from files that I increment weekly with a structure including the day the file is created.

So I have partitioned this file based dataset using a time-based partitioning using a "day" period.

What I notice now is that if I add a new file containing new rows, it will create a new partition with a column containing the partition date that will be the same for all rows, which I do not want in my case.

Whether in a new partition or not, I would like to keep the rows where the column with the partition date is already set and add the current date where necessary.

Note: I know there is a Similar question, but as I could not find an answer, I come to ask the question myself

 

Many thanks 😊


Operating system used: Windows

0 Kudos
0 Replies