Export recipe to local windows folders

Partner, L2 Admin, Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS Core Concepts, Registered Posts: 5 Partner

Hi there,

I am working with DSS on my local machine with the Windows Subsystem for Linux (Ubuntu). Is it possible to automate the import & export of files from & to my local windows folders with visual recipes as part of my flow? I have noticed there is an export recipe, but I don't know if / how to export to the windows folders with that recipe?

If the short answer is "no", would someone have a code recipe to share to do so? Note: I am not familiar with Linux, Python etc. But I understand how coding works, and know how to automate such tasks with VBA macros in excel files.

Thanks!

O.

Welcome!

It looks like you're new here. Sign in or register to get started.

Best Answer

  • Dataiker, Alpha Tester, Registered, Product Ideas Manager, Moderator Posts: 64 Dataiker
    Answer ✓

    Hi !

    Yes, it is possible to import/export files from/to a local Windows folder with DSS.

    The easiest way is to create a new filesystem connection linked to a Windows folder. Here is how to do it:

    - In Windows explorer, go to Drive C and creates a new folder named "DSS"

    - Start DSS, open your Web browser and go to DSS Administration > Connections.

    - Click "New connection" and select "Server Filesystem"

    - In "New connection name" field, enter "windows_filesystem"

    - In root path field, enter "/mnt/c/DSS".

    - Click Create

    You now have a filesystem connection that can read/write into the C:\DSS folder.

    folder-windows.png

    Open a project, go to the Flow and create a new Folder:

    - Click [+ Dataset] button and select "Folder". Choose a label (DSS for example) and click OK.

    You can now upload files from DSS into this folder. They will be stored in C:\DSS\<folder id> where <folder id> is the internal id of this folder (This ID will not change over time).

    To export a Dataset into this folder, you can use the "Export to folder" recipe and select the DSS folder we just created.

    export-recipe.png

    Et voilà!

Answers

  • Partner, L2 Admin, Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS Core Concepts, Registered Posts: 5 Partner

    Thank you Apichery, and apologies for the late acknowledgment! I didn't know we could navigate to the Windows Drive with a simple /mnt/c/ command I'm quite clear on the export side. On automating the import side, if I had 1000 csv files in a windows folder, to which I would want to automatically apply the same flow to get to a 1000 output csv files in an export folder, would there be an easy way to proceed without code?

  • Registered Posts: 2 ✭✭✭

    Hi,

    How about when the DSS is running from a server? How can similar export to a windows folder be achieved?

    Thanks a lot

  • Dataiker, Alpha Tester, Registered, Product Ideas Manager, Moderator Posts: 64 Dataiker

    Hi!

    It depends what you want to achieve. Where is your folder located?

    - If it is on the same Window server, you can follow the steps of the previous answer.

    - If it is located on another Windows server, you need to make it accessible to DSS. You could mount this remote folder onto a local directory on the server running DSS using Samba for example (https://www.redhat.com/sysadmin/samba-windows-linux)

  • Registered Posts: 2 ✭✭✭

    Hi

    the target folder would be umbrais case located in the user’s laptop. not in another folder

    thanks

  • Registered Posts: 5

    Hi @apichery
    @OD ,

    I am not able to get "Server Filesystem" in the connections. please guide here. screenshot attached.

  • Dataiker, Alpha Tester, Registered, Product Ideas Manager, Moderator Posts: 64 Dataiker

    Hi !

    In your case, it looks like you are using the Cloud version of DSS.

    DSS running on a remote server, it cannot have access to your local filesystem. If you want to upload files, the easiest way is to directly upload them directly in your project:

    - in the Flow, simply drag'n drop your CSV, Excel, files

    - Or select "+ Dataset" > Upload

    SCR-20240207-ocgp.png

    Hope this helps,
    Arnaud

Welcome!

It looks like you're new here. Sign in or register to get started.

Welcome!

It looks like you're new here. Sign in or register to get started.