Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
during pre-filter step, i only want to get the new dataset with limited data. so it should be updated autolly on daily basis.
I tried below formula but it is not workable.
( diff(val(now()),val('work_order_created_date')) >= 10 )
Please help me to get the right methods.
Thank you veyr much.
Operating system used: Windows
The challenge you describe is solved using the partitions functionality, which allows you to process a subset of data from a relative time range (see attached image).
My suggestions is that you start by completing this academy course on the subject, https://academy.dataiku.com/advanced-partitioning.
I hope this helps.