Trigger on Dataset Modified for Partitioned Dataset

Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 2 ✭✭

Hi Team

I'm reading the data from SharePoint and the format of the file is Cost Center_06092024.xlsx

As the file comes with the date format, I partitioned reading the data as /Cost Center_%M%D%Y.xlsx and in my prepare recipe set the option as Last available by that the flow ONLY get the latest file.

I'm trying to create a scenario as a Trigger on dataset change. Can you please help me with the option to use here?

Attached is the screenshot for reference

Thanks

Satish


Operating system used: Browser

Answers

  • Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,411 Neuron

    I believe the Dataset Changed trigger works with Sharepoint when you point it to a single individual file. So I don't think you will be able to have a dynamic file name.

    PS: Where do you set that Prepare recipe option for "Last Available"?

Welcome!

It looks like you're new here. Sign in or register to get started.

Welcome!

It looks like you're new here. Sign in or register to get started.