Upload file from local to the server
Hi ,
I have dataiku install in the server, and I would like to upload some setup file (Jar files or jaon file) from my local machine to the dss server using dataiku.
i know I could use scp from my local, however, I would like to create dataiku macros to automate this activity.
Best Answers
-
Hi,
You could upload to a managed folder and (as a plugin developer) write a macro that copies the file from the managed folder to a directory of your choosing on the server. The DSS administrator still needs to add JARs from this directory in the Spark configuration.
-
CoreyS Dataiker Alumni, Dataiku DSS Core Designer, Dataiku DSS Core Concepts, Registered Posts: 1,150 ✭✭✭✭✭✭✭✭✭OptionsHi @Bader
you can upload and download files from the managed folder using the Public REST APIMore info on Managed Folders can be found here
I hope this helps!
Answers
-
Hi,
By security design, DSS (and the server hosting it) does not have remote access to your local machine.
Could you please detail what type of setup file you want to push to the DSS server?
Best regards,
Alex
-
Hi Alex,
Our servers have no connection to internet. Therefore, I want to push Jar files for spark-scala. this activity is not just one time, we need to push spark-scala packages whenever, we need new packages.
Because of that, I want to automate this activity without having admin user get in the server in scp to folder.
-
Hi Clement,
How to upload file to manage folder ?
-
Hi Clement,
Do you have a sample code that will upload a file to a managed folder from my local machine? I want to be able to use it in my flow as a recipe or plugin.
I have tried creating a WebApp and converting it to a plugin, but it didn't work.
Thanks!
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,757 NeuronOptionsPlease start a new thread. This thread has been marked as solved already.
