DSS Event server setup - Destination

Erylis
Erylis Registered Posts: 5 ✭✭✭✭

Hello,

I've setting up an Event server wich is suppose to write on an Azure Blob Storage.

The server is not able to write and the foolowing error show up :

[2022/10/11-13:17:53.611] [QueueHandler-target-ConnectionPathTarget-1] [INFO] [dku.datasets.bloblike]  - Writing base=/apicall/2022/10/11/ split=0 chunk=0 -> target = /apicall/2022/10/11//out-s0-2022-10-11-13-17-53-611.gz
[2022/10/11-13:17:53.611] [QueueHandler-target-ConnectionPathTarget-1] [WARN] [dku.eventserver.queue]  - Processing error
java.io.IOException: Failed to write /apicall/2022/10/11//out-s0-2022-10-11-13-17-53-611.gz
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.tryCode(AzureBlobStorageFSProvider.java:136)
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.write(AzureBlobStorageFSProvider.java:668)
        at com.dataiku.dip.datasets.fs.BlobLikeResplitOutputWriter.init(BlobLikeResplitOutputWriter.java:64)
        at com.dataiku.dip.eventserver.targets.ConnectionPathTarget.getOrOpenPartition(ConnectionPathTarget.java:252)
        at com.dataiku.dip.eventserver.targets.ConnectionPathTarget.process(ConnectionPathTarget.java:288)
        at com.dataiku.dip.eventserver.ProcessingQueue$QueueHandler.run(ProcessingQueue.java:54)
        at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.IllegalArgumentException: The String is not a valid Base64-encoded string.
        at com.dataiku.dss.shadelib.com.microsoft.azure.storage.core.Base64.decode(Base64.java:88)
        at com.dataiku.dss.shadelib.com.microsoft.azure.storage.StorageCredentialsAccountAndKey.<init>(StorageCredentialsAccountAndKey.java:81)
        at com.dataiku.dip.connections.AzureConnection.getAzureBlobCredentials(AzureConnection.java:204)
        at com.dataiku.dip.connections.AzureConnection.getAzureBlobClient(AzureConnection.java:136)
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.getContainer(AzureBlobStorageFSProvider.java:145)
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.write(AzureBlobStorageFSProvider.java:653)
        ... 5 more

The settings of the connection and the event server are in the attachments.

Could you help me ?

Best regards,

Best Answer

  • Zach
    Zach Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 153 Dataiker
    Answer ✓

    Hi @Erylis
    ,

    Just to confirm, does this connection work outside of Event Server? For example, can you create a dataset with the connection?

    If it works outside of Event Server, then this is a known bug with the version of DSS that you're using. Event Server is unable to decrypt the credentials when using an Azure connection with a shared key.

    You can fix the issue by upgrading to a newer version of DSS. The issue was fixed in DSS 9.0.4.

    Thanks,

    Zach

Answers

Setup Info
    Tags
      Help me…