DSS Event server setup - Destination

Erylis
Erylis Registered Posts: 5 ✭✭✭✭
edited July 2024 in Setup & Configuration

Hello,

I've setting up an Event server wich is suppose to write on an Azure Blob Storage.

The server is not able to write and the foolowing error show up :

[2022/10/11-13:17:53.611] [QueueHandler-target-ConnectionPathTarget-1] [INFO] [dku.datasets.bloblike]  - Writing base=/apicall/2022/10/11/ split=0 chunk=0 -> target = /apicall/2022/10/11//out-s0-2022-10-11-13-17-53-611.gz
[2022/10/11-13:17:53.611] [QueueHandler-target-ConnectionPathTarget-1] [WARN] [dku.eventserver.queue]  - Processing error
java.io.IOException: Failed to write /apicall/2022/10/11//out-s0-2022-10-11-13-17-53-611.gz
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.tryCode(AzureBlobStorageFSProvider.java:136)
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.write(AzureBlobStorageFSProvider.java:668)
        at com.dataiku.dip.datasets.fs.BlobLikeResplitOutputWriter.init(BlobLikeResplitOutputWriter.java:64)
        at com.dataiku.dip.eventserver.targets.ConnectionPathTarget.getOrOpenPartition(ConnectionPathTarget.java:252)
        at com.dataiku.dip.eventserver.targets.ConnectionPathTarget.process(ConnectionPathTarget.java:288)
        at com.dataiku.dip.eventserver.ProcessingQueue$QueueHandler.run(ProcessingQueue.java:54)
        at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.IllegalArgumentException: The String is not a valid Base64-encoded string.
        at com.dataiku.dss.shadelib.com.microsoft.azure.storage.core.Base64.decode(Base64.java:88)
        at com.dataiku.dss.shadelib.com.microsoft.azure.storage.StorageCredentialsAccountAndKey.<init>(StorageCredentialsAccountAndKey.java:81)
        at com.dataiku.dip.connections.AzureConnection.getAzureBlobCredentials(AzureConnection.java:204)
        at com.dataiku.dip.connections.AzureConnection.getAzureBlobClient(AzureConnection.java:136)
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.getContainer(AzureBlobStorageFSProvider.java:145)
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.write(AzureBlobStorageFSProvider.java:653)
        ... 5 more

The settings of the connection and the event server are in the attachments.

Could you help me ?

Best regards,

· Share on FacebookShare on Twitter

Best Answer

  • Zach
    Zach Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 153 Dataiker
    Answer ✓

    Hi @Erylis
    ,

    Just to confirm, does this connection work outside of Event Server? For example, can you create a dataset with the connection?

    If it works outside of Event Server, then this is a known bug with the version of DSS that you're using. Event Server is unable to decrypt the credentials when using an Azure connection with a shared key.

    You can fix the issue by upgrading to a newer version of DSS. The issue was fixed in DSS 9.0.4.

    Thanks,

    Zach

    · Share on FacebookShare on Twitter

Answers

Bookmark this topic

Categories

Setup Info
    Tags
      Help me…