"No DSS URL or API key found from any location" when trying to get path of a dataset

[Rupinder]

Hello,

I am trying to access a csv file uploaded in a folder in dataiku managedfolder stored in DSS filesystem. I want to access this csv dataset in my API designer Python Function (Exposing python function as an API). Its throwing an error when I run following code:

handle = dataiku.Folder("FOLDER_ID")

path = handle.get_path()

error is "No DSS URL or API key found from any location" seems like its not able to locate my folder (I tried folder name instead of folder ID as well).

Before this error, I was having different error "Default project key is not specified (no DKU_CURRENT_PROJECT_KEY in env)" that was resolved using:

os.environ["DKU_CURRENT_PROJECT_KEY"] = "PROJECT_KEY"

Has anyone dealt with such an issue.

---

Operating system used: Linux

[AlexT · Accepted solution]

Hi @Rupinder ,

When accessing file from a managed folder from the API Endpoint Python function you have 2 options:

1) Provide the full information like the project, DSS URL, and API Key within your Python function and use read/write APIs for managed folder and not local filesystem access. Please see the sample here:

https://community.dataiku.com/t5/Using-Dataiku/Read-a-file-outside-the-API-folder-from-a-DSS-API/m-p...

This resolves your current error "No DSS URL or API key found from any location". This happens because by design API Designer functions are meant to run outside of the DSS instance. 

2) If feasible given folder size. DSS automatically bundles all files inside managed folders that are defined as working folders in API Endpoint settings

This means you can sample Python code to read the files directly from the API Node from managed folder that are set as working folders. 

import os 

def get_file(file_name):
    file_path_list = []
    for index in range(len(folders)):
        file_path = os.path.join(folders[index], file_name)
        try:
            with open(file_path) as f:
                print('Printing first line of {} file'.format(file_name))
                print(f.readline())
                # Do something with the file
            file_path_list.append(file_path)    
        except IOError:
            print("File {} not accessible".format(file_path))
    
    return file_path_list

def main(file_name):
    file_path_list = get_file(file_name)
        
    return file_path_list

Let me know if you have any questions. 

[Rupinder]

@AlexT Perfect! It worked. Thank you.