How to import batch of CSV's with different schema from local folder
UserBird
Dataiker, Alpha Tester Posts: 535 Dataiker
I have been using the visual recipes to clean and stack a set of data files (CSV's). They do not all have a single schema, but rather various parts of an overall schema (what the final 'stacked' dataset will be). Instead of uploading each file individually (over 100), I would like to upload them all into my flow at once. The files are all contained in one folder on my hard drive.
Tagged:
Answers
-
The best solution for this would be to upload all csv files to a folder, and use a python recipe to create the final dataset.