Export recipe to local windows folders
Hi there,
I am working with DSS on my local machine with the Windows Subsystem for Linux (Ubuntu). Is it possible to automate the import & export of files from & to my local windows folders with visual recipes as part of my flow? I have noticed there is an export recipe, but I don't know if / how to export to the windows folders with that recipe?
If the short answer is "no", would someone have a code recipe to share to do so? Note: I am not familiar with Linux, Python etc. But I understand how coding works, and know how to automate such tasks with VBA macros in excel files.
Thanks!
O.
Best Answer
-
Hi !
Yes, it is possible to import/export files from/to a local Windows folder with DSS.
The easiest way is to create a new filesystem connection linked to a Windows folder. Here is how to do it:
- In Windows explorer, go to Drive C and creates a new folder named "DSS"
- Start DSS, open your Web browser and go to DSS Administration > Connections.
- Click "New connection" and select "Server Filesystem"
- In "New connection name" field, enter "windows_filesystem"
- In root path field, enter "/mnt/c/DSS".
- Click Create
You now have a filesystem connection that can read/write into the C:\DSS folder.
Open a project, go to the Flow and create a new Folder:
- Click [+ Dataset] button and select "Folder". Choose a label (DSS for example) and click OK.
You can now upload files from DSS into this folder. They will be stored in C:\DSS\<folder id> where <folder id> is the internal id of this folder (This ID will not change over time).
To export a Dataset into this folder, you can use the "Export to folder" recipe and select the DSS folder we just created.
Et voilà!
Answers
-
OD Partner, L2 Admin, Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS Core Concepts, Registered Posts: 5 Partner
Thank you Apichery, and apologies for the late acknowledgment! I didn't know we could navigate to the Windows Drive with a simple /mnt/c/ command
I'm quite clear on the export side. On automating the import side, if I had 1000 csv files in a windows folder, to which I would want to automatically apply the same flow to get to a 1000 output csv files in an export folder, would there be an easy way to proceed without code? -
Hi,
How about when the DSS is running from a server? How can similar export to a windows folder be achieved?
Thanks a lot
-
Hi!
It depends what you want to achieve. Where is your folder located?
- If it is on the same Window server, you can follow the steps of the previous answer.
- If it is located on another Windows server, you need to make it accessible to DSS. You could mount this remote folder onto a local directory on the server running DSS using Samba for example (https://www.redhat.com/sysadmin/samba-windows-linux)
-
Hi
the target folder would be umbrais case located in the user’s laptop. not in another folder
thanks
-
Hi !
In your case, it looks like you are using the Cloud version of DSS.
DSS running on a remote server, it cannot have access to your local filesystem. If you want to upload files, the easiest way is to directly upload them directly in your project:
- in the Flow, simply drag'n drop your CSV, Excel, files
- Or select "+ Dataset" > Upload
Hope this helps,
Arnaud