How to extract the records in latest process date?
grace
Registered Posts: 1 ✭✭✭
I have a table in daily update frequency which full dump of records are daily appended to it.
I want to extract the latest process date to perform analysis? Can anyone share a way to do it (not hardcoding)?
Best Answer
-
Manuel Alpha Tester, Dataiker Alumni, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Dataiku DSS Adv Designer, Registered Posts: 193 ✭✭✭✭✭✭✭Hi,
You should explore the concept of Partitioning, which allows you to run your flow just for a chunk of data. For example, in an SQL dataset, you can just process the last available date of a specific column.
See the following resources:
//play.vidyard.com/w7ozrFT3REzedHvv6hKriJ.html?
I hope this helps.