Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Setting up an SSH tunnel for DSS Connection
Added on January 22, 2021 6:01AM
Likes: 1
Replies: 8
tgb417
Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,617 Neuron
What is the best way to configure a design node to make a secure connection to a PostgreSQL server?
I'm thinking that an ssh tunnel might be a way, using an ssh command like this:
ssh -L5211:/var/run/postgresql/.s.PGSQL.5432 account@myremotehost.com
The above seems to complete successfully from my localhost.
Then to create a Postgress DSS Connection sort of like this:
Host = localhost
Database = mydatabase
port = 5211
User = account
Password = [blank]
Unfortunately. when trying to test this connection I get.
When I look at the "more errors" link I get.
If folks think that this is a good approach for connecting to a PostgreSQL server remotely in an encrypted way to a design node. Then I also wonder if there is a way to automatically make setup of the ssh tunnel each time that DSS is started or each time this connection is used less manual. From an operational point of view, I'd hate to have to manually start the ssh tunnel, then start DSS.
I'm currently working from a macintosh computer running OSX 10.13.x, connecting to a Linux remote server with the PostgreSQL server.
Answers
-
Hi
considering the settings in the DSS connection, why not simply:
ssh -L 5211:localhost:5432 account@myremotehost.com
Is your postgresql server not binding on all interfaces for port 5432? (on the remote machine)
Regards,
Frederic
-
tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,617 Neuron
I found that a command:
ssh -N -L 5211:/var/run/postgresql/.s.PGSQL.5432 account@myremotehost.com
Worked OK.
Note: I add a space between the “L” and the first “5” and adding a “-N” as the first parameter of the command.
I also found that you had to click the create button on the DSS connection screen before you could test the connection without error.
Now the question, I'd like to grant DSS the opportunity to set up its own secure tunnel rather than having to go to a terminal window to open the tunnel. Is there a "safe" and "effective" way to get this done?
-
DSS has no facility to open SSH tunnels on your behalf. If you need tunnels, it's a manual process
-
tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,617 Neuron
Thanks for the insight.
-
quick question, how to type this command on dataiku
I don't find any cmd or terminal like in dataiku dss -
tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,617 Neuron
This command was not typed into dss directly. This was being typed into a separate terminal connection of the operating system supporting the DSS Server application.
Hope that helps.
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,315 Neuron -
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,315 Neuron
I forgot to mention SSHFS. While is less than ideal to use SSH as a file system if that's the only option you got SSHFS might be a viable option. Don't expect proper file system reliability over these SSH mounts so make sure you build resiliancy in your processes to handle connection issues.
