Read from S3 connection basis last modified date

pnaik1 Registered Posts: 23 ✭✭✭✭

Hi all, I have a S3 connection from which I can access data kept on S3. However, the data is huge and I want to read only data which is modified lately. Also I can't filter using end_date as other team is doing full refresh of data and uploading all data on daily basis.


So in simple terms, I want to access only yellow highlighted files (these are the latest files modified). Is there direct way or through python recipe for achieving this?

Thanks in advance!


Setup Info
      Help me…