DSS Event server setup - Destination

Erylis

Hello,

I've setting up an Event server wich is suppose to write on an Azure Blob Storage.

The server is not able to write and the foolowing error show up :

[2022/10/11-13:17:53.611] [QueueHandler-target-ConnectionPathTarget-1] [INFO] [dku.datasets.bloblike]  - Writing base=/apicall/2022/10/11/ split=0 chunk=0 -> target = /apicall/2022/10/11//out-s0-2022-10-11-13-17-53-611.gz
[2022/10/11-13:17:53.611] [QueueHandler-target-ConnectionPathTarget-1] [WARN] [dku.eventserver.queue]  - Processing error
java.io.IOException: Failed to write /apicall/2022/10/11//out-s0-2022-10-11-13-17-53-611.gz
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.tryCode(AzureBlobStorageFSProvider.java:136)
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.write(AzureBlobStorageFSProvider.java:668)
        at com.dataiku.dip.datasets.fs.BlobLikeResplitOutputWriter.init(BlobLikeResplitOutputWriter.java:64)
        at com.dataiku.dip.eventserver.targets.ConnectionPathTarget.getOrOpenPartition(ConnectionPathTarget.java:252)
        at com.dataiku.dip.eventserver.targets.ConnectionPathTarget.process(ConnectionPathTarget.java:288)
        at com.dataiku.dip.eventserver.ProcessingQueue$QueueHandler.run(ProcessingQueue.java:54)
        at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.IllegalArgumentException: The String is not a valid Base64-encoded string.
        at com.dataiku.dss.shadelib.com.microsoft.azure.storage.core.Base64.decode(Base64.java:88)
        at com.dataiku.dss.shadelib.com.microsoft.azure.storage.StorageCredentialsAccountAndKey.<init>(StorageCredentialsAccountAndKey.java:81)
        at com.dataiku.dip.connections.AzureConnection.getAzureBlobCredentials(AzureConnection.java:204)
        at com.dataiku.dip.connections.AzureConnection.getAzureBlobClient(AzureConnection.java:136)
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.getContainer(AzureBlobStorageFSProvider.java:145)
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.write(AzureBlobStorageFSProvider.java:653)
        ... 5 more

The settings of the connection and the event server are in the attachments.

Could you help me ?

Best regards,

Zach

Hi @Erylis
,

Just to confirm, does this connection work outside of Event Server? For example, can you create a dataset with the connection?

If it works outside of Event Server, then this is a known bug with the version of DSS that you're using. Event Server is unable to decrypt the credentials when using an Azure connection with a shared key.

You can fix the issue by upgrading to a newer version of DSS. The issue was fixed in DSS 9.0.4.

Thanks,

Zach

Erylis

HI @ZachM
,

Thank you for your answer.

The connection work outside of Event Server so it should be the bug you mentionned.

Do you have a link to the identified bug ?

Best Regards,