Sharing DATADIR across various instances ?

gnaldi62
gnaldi62 Partner, L2 Designer, Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Frontrunner 2022 Participant, Neuron 2023 Posts: 79 Neuron

Hi all,

our client is thinking to have different Design nodes pointing to the same DATADIR, which is then shared across them. In front of it, a load balances would direct the traffic to the various instances. I strongly believe this is not possible because there is a big problem of synchronizing the updates applied to the same portion of the filesystem.

Am I wrong in saying this is not possible or does someone have implemented it and can say it's working ?
Which are the actual showstoppers ? Is it worth trying to implement that ?

Thanks in advance. Best Regards.

Giuseppe

Best Answer

Setup Info
    Tags
      Help me…