Trigger on Dataset Modified for Partitioned Dataset
Satish
Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 2 ✭✭
Hi Team
I'm reading the data from SharePoint and the format of the file is Cost Center_06092024.xlsx
As the file comes with the date format, I partitioned reading the data as /Cost Center_%M%D%Y.xlsx and in my prepare recipe set the option as Last available by that the flow ONLY get the latest file.
I'm trying to create a scenario as a Trigger on dataset change. Can you please help me with the option to use here?
Attached is the screenshot for reference
Thanks
Satish
Operating system used: Browser
Tagged:
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,090 Neuron
I believe the Dataset Changed trigger works with Sharepoint when you point it to a single individual file. So I don't think you will be able to have a dynamic file name.
PS: Where do you set that Prepare recipe option for "Last Available"?