DSS Event server setup - Destination

Options
Erylis
Erylis Registered Posts: 5 ✭✭✭✭

Hello,

I've setting up an Event server wich is suppose to write on an Azure Blob Storage.

The server is not able to write and the foolowing error show up :

[2022/10/11-13:17:53.611] [QueueHandler-target-ConnectionPathTarget-1] [INFO] [dku.datasets.bloblike] - Writing base=/apicall/2022/10/11/ split=0 chunk=0 -> target = /apicall/2022/10/11//out-s0-2022-10-11-13-17-53-611.gz[2022/10/11-13:17:53.611] [QueueHandler-target-ConnectionPathTarget-1] [WARN] [dku.eventserver.queue] - Processing errorjava.io.IOException: Failed to write /apicall/2022/10/11//out-s0-2022-10-11-13-17-53-611.gzat com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.tryCode(AzureBlobStorageFSProvider.java:136)at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.write(AzureBlobStorageFSProvider.java:668)at com.dataiku.dip.datasets.fs.BlobLikeResplitOutputWriter.init(BlobLikeResplitOutputWriter.java:64)at com.dataiku.dip.eventserver.targets.ConnectionPathTarget.getOrOpenPartition(ConnectionPathTarget.java:252)at com.dataiku.dip.eventserver.targets.ConnectionPathTarget.process(ConnectionPathTarget.java:288)at com.dataiku.dip.eventserver.ProcessingQueue$QueueHandler.run(ProcessingQueue.java:54)at java.lang.Thread.run(Thread.java:750)Caused by: java.lang.IllegalArgumentException: The String is not a valid Base64-encoded string.at com.dataiku.dss.shadelib.com.microsoft.azure.storage.core.Base64.decode(Base64.java:88)at com.dataiku.dss.shadelib.com.microsoft.azure.storage.StorageCredentialsAccountAndKey.<init>(StorageCredentialsAccountAndKey.java:81)at com.dataiku.dip.connections.AzureConnection.getAzureBlobCredentials(AzureConnection.java:204)at com.dataiku.dip.connections.AzureConnection.getAzureBlobClient(AzureConnection.java:136)at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.getContainer(AzureBlobStorageFSProvider.java:145)at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.write(AzureBlobStorageFSProvider.java:653)... 5 more

The settings of the connection and the event server are in the attachments.

Could you help me ?

Best regards,

Best Answer

  • Zach
    Zach Dataiker, Dataiku DSS Core Designer, Dataiku DSS Adv Designer, Registered Posts: 153 Dataiker
    Answer ✓
    Options

    Hi @Erylis
    ,

    Just to confirm, does this connection work outside of Event Server? For example, can you create a dataset with the connection?

    If it works outside of Event Server, then this is a known bug with the version of DSS that you're using. Event Server is unable to decrypt the credentials when using an Azure connection with a shared key.

    You can fix the issue by upgrading to a newer version of DSS. The issue was fixed in DSS 9.0.4.

    Thanks,

    Zach

Answers

Setup Info
    Tags
      Help me…