You now have until September 15th to submit your use case or success story to the 2022 Dataiku Frontrunner Awards!ENTER YOUR SUBMISSION

How to extract the records in latest process date?

Solved!
grace
Level 1
How to extract the records in latest process date?

I have a table in daily update frequency which full dump of records are daily appended to it.

I want to extract the latest process date to perform analysis? Can anyone share a way to do it (not hardcoding)?

0 Kudos
1 Solution
Manuel
Dataiker
Dataiker

Hi,

You should explore the concept of Partitioning, which allows you to run your flow just for a chunk of data. For example, in an SQL dataset, you can just process the last available date of a specific column.

See the following resources:

I hope this helps.

 

View solution in original post

1 Reply
Manuel
Dataiker
Dataiker

Hi,

You should explore the concept of Partitioning, which allows you to run your flow just for a chunk of data. For example, in an SQL dataset, you can just process the last available date of a specific column.

See the following resources:

I hope this helps.