How to import batch of CSV's with different schema from local folder

Options
UserBird
UserBird Dataiker, Alpha Tester Posts: 535 Dataiker
I have been using the visual recipes to clean and stack a set of data files (CSV's). They do not all have a single schema, but rather various parts of an overall schema (what the final 'stacked' dataset will be). Instead of uploading each file individually (over 100), I would like to upload them all into my flow at once. The files are all contained in one folder on my hard drive.

Answers

  • cperdigou
    cperdigou Alpha Tester, Dataiker Alumni Posts: 115 ✭✭✭✭✭✭✭
    Options
    The best solution for this would be to upload all csv files to a folder, and use a python recipe to create the final dataset.
Setup Info
    Tags
      Help me…