How to get the list of Directories from the managed folder in R recipe of Dataiku.

Options
shashankmittal
shashankmittal Dataiku DSS Core Designer, Registered Posts: 6

Hi Team

we are having a managed folder in Dataiku which we have created with the help of BOX plugin. Below is the configuration of the managed folder.

BOX_1.png

Now, we want to get the list of high-level directories which are present in this managed folder using R recipe of dataiku. we don't need any sub directories name or any file name from sub directories.
we tried to use the dkuManagedFolderPartitionPaths() to get the paths but it is taking a lot of time because we are having a lot of files in sub-directories.
Is there any other way to get the list of directories from managed folder in R recipe of Dataiku?

Answers

  • Alexandru
    Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,209 Dataiker
    Options

    Hi,
    The dkuManagedFolderPartitionPaths is the only function to list paths in a managed folder in R, https://doc.dataiku.com/dss/api/latest/R/dataiku/reference/ This can take a long time if there are a lot of files/directories.

    What I can suggest is to use the browse option in UI to list top-level directories and then create separate folder connections for these top-level directories.

Setup Info
    Tags
      Help me…