Submit your innovative use case or inspiring success story to the 2023 Dataiku Frontrunner Awards! LET'S GO

Import multiple files stored in Sharepoint at one time

Solved!
dot101
Level 2
Import multiple files stored in Sharepoint at one time

Hello,

As shown in the image below, I have several Excel files stored in the Sharepoint site, my goal is to import all the files and later stack them into one dataset, is this possible? How, please.
There are too many files that I can't import individually, and every week two files are added, so I want to automate this.

Thanks for any help.

0 Kudos
1 Solution
AlexT
Dataiker

Hi,

You can do this with Files from Folder dataset.

Create a folder with the Sharepoint location where these files are added. Then create a "Files from the folder" dataset. +Dataset - Internal - Files from Folder. Go to the advanced option once you select the folder and then use regex/glob to match you file pattern. 

Now if you use this dataset every time you build your flow it will read all files that match this pattern including new files that were added. 

Screenshot 2022-03-16 at 21.31.04.png

 

Screenshot 2022-03-16 at 21.32.58.pngScreenshot 2022-03-16 at 21.33.13.png

Let me know if this works for you!

View solution in original post

0 Kudos
2 Replies
AlexT
Dataiker

Hi,

You can do this with Files from Folder dataset.

Create a folder with the Sharepoint location where these files are added. Then create a "Files from the folder" dataset. +Dataset - Internal - Files from Folder. Go to the advanced option once you select the folder and then use regex/glob to match you file pattern. 

Now if you use this dataset every time you build your flow it will read all files that match this pattern including new files that were added. 

Screenshot 2022-03-16 at 21.31.04.png

 

Screenshot 2022-03-16 at 21.32.58.pngScreenshot 2022-03-16 at 21.33.13.png

Let me know if this works for you!

0 Kudos
dot101
Level 2
Author

Hi Alex, this is what I was looking for, thanks a lot!

0 Kudos