No option for files in folders

hisyam
hisyam Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 16

I'm trying to pull data from the Internal > Files from folders. From what I understand, this option should give me an option to choose existing folders within my server, right?

However, when I tried to click on the drop-down menu, it's not expanding anything.

Can someone assist me on this or explain why it's behaving as such? Am I missing out on something crucial before I can use the files from folders option?


Operating system used: Linux

Answers

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,978 Neuron

    "From what I understand, this option should give me an option to choose existing folders within my server, right?"

    Sort of. The process works like this. First you create a file system connection which points to a specific and existing folder in the OS. Then in your Flow you add a Managed Folder using the connection, which creates a folder inside your file system connection. Finally you use the Files in Folder dataset to point it to a Managed Folder and read files from it. Here is how it looks like logically:

    File system connection => Managed Folder => Files in Folder

    If you want to use an existing OS folder you can follow the same process as above and then inside your new Managed Folder you can create a symlink to your existing folder so it will appear as it is nested inside your new Managed Folder.

Setup Info
    Tags
      Help me…