Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
How to extract the records in latest process date?
Added on May 30, 2022 9:19AM
Likes: 0
Replies: 1
grace
Registered Posts: 1 ✭✭✭
I have a table in daily update frequency which full dump of records are daily appended to it.
I want to extract the latest process date to perform analysis? Can anyone share a way to do it (not hardcoding)?
Best Answer
-
Manuel Alpha Tester, Dataiker Alumni, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Dataiku DSS Adv Designer, Registered Posts: 193 ✭✭✭✭✭✭✭Hi,
You should explore the concept of Partitioning, which allows you to run your flow just for a chunk of data. For example, in an SQL dataset, you can just process the last available date of a specific column.
See the following resources:
//play.vidyard.com/w7ozrFT3REzedHvv6hKriJ.html?
I hope this helps.