How do I get a file imported through the sharepoint plugin to update in Dataiku?

mbillingham
Level 2
How do I get a file imported through the sharepoint plugin to update in Dataiku?

Hello-

We have successfully installed and configured the sharepoint plugin and uploaded a file to Dataiku. We want to use that as a source for a flow and integrate it with other data. This works but it doesn't update in Dataiku after updates to the file occur in sharepoint. How do I get Dataiku to pick up updates to this file? To clarify: I don't need the scenario to trigger, I just need the source to refresh when I run the scenario. Right now it just has the data from when I created the dataset. 

thank you in advance!


Operating system used: Linux

0 Kudos
1 Reply
AlexB
Dataiker

Hello,

Indeed what you can see in the explore section of the SharePoint datset is cached, but every time you start a build operation of anything linked to that dataset, Dataiku will then retrieve the data at the source.

One thing you can do is to use a sync recipe between your SharePoint dataset and another local dataset for instance, and get a scenario to trigger the build of that local dataset. The second dataset will be updated even though the initial SharePoint dataset still shows the initial cached data.

0 Kudos