DSS compatibility with MinIO

Alby92
Alby92 Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 4 Partner

I have a question about a possible compatibility between MinIO and DSS.

By reading the documentation I have noticed that MinIO is not listed in the supported DSS data sources.

MinIO, however, is compatible with Amazon S3, which is supported by DSS.

So I've tried to set up and Amazon S3 connection in DSS. The connection itself seems to work fine as shown in the screen below

MinIOConnection.PNG

But when I tried to create a dataset by using this connection I run into this error:

Browse failed: Failed to connect to S3, caused by: AmazonS3Exception: The AWS Access Key Id you provided does not exist in our records.

MinIO Error.PNG

The strange fact is that DSS is able to enumerate the buckets, but when trying to browse the bucket content it returns that error.

I'm using DSS Community Edition (version 9.0.1) running in a VM. The MinIO server (version RELEASE.2021-04-22T15-44-28Z) is running on the same virtual machine.

Has someone ever experienced something like this before? Can you help me trying to figure out what's the problem? Is it a configuration problem or is it just and incompatibility issue?

Let me know if you need additional information.

Any help is strongly appreciated.

Thanks in advance.

Best Answer

  • MarcH
    MarcH Dataiker Posts: 26 Dataiker
    Answer ✓

    Hello,

    Could you please try unchecking the "Switch to bucket region" checkbox (under the Region/Endpoint field) and checking the "Use path style" checkbox down in the Advanced section of the connection settings?

Answers

  • Alby92
    Alby92 Partner, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 4 Partner

    Hi MarcH.

    I solved the problem by unchecking "Switch to bucket region" checkbox.

    Thank you very much.

Setup Info
    Tags
      Help me…