Trigger on Dataset Modified for Partitioned Dataset

Satish
Satish Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 2 ✭✭

Hi Team

I'm reading the data from SharePoint and the format of the file is Cost Center_06092024.xlsx

As the file comes with the date format, I partitioned reading the data as /Cost Center_%M%D%Y.xlsx and in my prepare recipe set the option as Last available by that the flow ONLY get the latest file.

I'm trying to create a scenario as a Trigger on dataset change. Can you please help me with the option to use here?

Attached is the screenshot for reference

Thanks

Satish


Operating system used: Browser

Tagged:

Answers

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,090 Neuron

    I believe the Dataset Changed trigger works with Sharepoint when you point it to a single individual file. So I don't think you will be able to have a dynamic file name.

    PS: Where do you set that Prepare recipe option for "Last Available"?

Setup Info
    Tags
      Help me…