Read from S3 connection basis last modified date

pnaik1
pnaik1 Registered Posts: 23 ✭✭✭✭

Hi all, I have a S3 connection from which I can access data kept on S3. However, the data is huge and I want to read only data which is modified lately. Also I can't filter using end_date as other team is doing full refresh of data and uploading all data on daily basis.

pic.png

So in simple terms, I want to access only yellow highlighted files (these are the latest files modified). Is there direct way or through python recipe for achieving this?

Thanks in advance!

Answers

Setup Info
    Tags
      Help me…