How to extract the records in latest process date?

[grace]

I have a table in daily update frequency which full dump of records are daily appended to it.

I want to extract the latest process date to perform analysis? Can anyone share a way to do it (not hardcoding)?

[Manuel · Accepted solution]

Hi,

You should explore the concept of Partitioning, which allows you to run your flow just for a chunk of data. For example, in an SQL dataset, you can just process the last available date of a specific column.

See the following resources:

• https://doc.dataiku.com/dss/latest/partitions/index.html

I hope this helps.