Discover all of the brand-new features and improvements to existing capabilities in the Dataiku 11.3 updateLET'S GO

How to extract the records in latest process date?

Solved!
grace
Level 1
How to extract the records in latest process date?

I have a table in daily update frequency which full dump of records are daily appended to it.

I want to extract the latest process date to perform analysis? Can anyone share a way to do it (not hardcoding)?

0 Kudos
1 Solution
Manuel
Dataiker Alumni

Hi,

You should explore the concept of Partitioning, which allows you to run your flow just for a chunk of data. For example, in an SQL dataset, you can just process the last available date of a specific column.

See the following resources:

I hope this helps.

 

View solution in original post

1 Reply
Manuel
Dataiker Alumni

Hi,

You should explore the concept of Partitioning, which allows you to run your flow just for a chunk of data. For example, in an SQL dataset, you can just process the last available date of a specific column.

See the following resources:

I hope this helps.