HDFS connectiion creation

SAURABH
SAURABH Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Dataiku DSS Adv Designer, Registered Posts: 30 Partner
in General

Hi Team
do we have any script present to create mutiple connection in go itself.

We have to created more than 15 HDFS connection and tag mutiple groups to these connection.
Manual approach towards it will consume a lot of time.

if any one has any idea on how can you reduce the manual efforts around this.

Operating system used: linux

· Share on Facebook

Answers

  • Alexandru
    Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,399 Dataiker

    Hi @saurabh

    You could use the Python API with create_connection and create multiple connections from Python code rather then manually.
    You can find several examples here :
    https://doc.dataiku.com/dss/latest/python-api/connections.html

    · Share on Facebook
  • Srkanoje
    Srkanoje Registered Posts: 37 ✭✭✭✭
    edited July 2024

    @AlexT
    i have created a script but got stuck on adding the readable by details and its groups because of the nested functionality, can you please suggest here.

    new_connection = client.create_connection('test_connection', type='MySql', params=new_connection_params, usable_by='ALLOWED', allowed_groups=['administrators', 'data_team'])

    · Share on Facebook
Bookmark this topic

Categories

Setup Info
    Tags
      Help me…