Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
Added on October 11, 2022 2:46PM
Likes: 0
Replies: 2
Hello,
I've setting up an Event server wich is suppose to write on an Azure Blob Storage.
The server is not able to write and the foolowing error show up :
[2022/10/11-13:17:53.611] [QueueHandler-target-ConnectionPathTarget-1] [INFO] [dku.datasets.bloblike] - Writing base=/apicall/2022/10/11/ split=0 chunk=0 -> target = /apicall/2022/10/11//out-s0-2022-10-11-13-17-53-611.gz [2022/10/11-13:17:53.611] [QueueHandler-target-ConnectionPathTarget-1] [WARN] [dku.eventserver.queue] - Processing error java.io.IOException: Failed to write /apicall/2022/10/11//out-s0-2022-10-11-13-17-53-611.gz at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.tryCode(AzureBlobStorageFSProvider.java:136) at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.write(AzureBlobStorageFSProvider.java:668) at com.dataiku.dip.datasets.fs.BlobLikeResplitOutputWriter.init(BlobLikeResplitOutputWriter.java:64) at com.dataiku.dip.eventserver.targets.ConnectionPathTarget.getOrOpenPartition(ConnectionPathTarget.java:252) at com.dataiku.dip.eventserver.targets.ConnectionPathTarget.process(ConnectionPathTarget.java:288) at com.dataiku.dip.eventserver.ProcessingQueue$QueueHandler.run(ProcessingQueue.java:54) at java.lang.Thread.run(Thread.java:750) Caused by: java.lang.IllegalArgumentException: The String is not a valid Base64-encoded string. at com.dataiku.dss.shadelib.com.microsoft.azure.storage.core.Base64.decode(Base64.java:88) at com.dataiku.dss.shadelib.com.microsoft.azure.storage.StorageCredentialsAccountAndKey.<init>(StorageCredentialsAccountAndKey.java:81) at com.dataiku.dip.connections.AzureConnection.getAzureBlobCredentials(AzureConnection.java:204) at com.dataiku.dip.connections.AzureConnection.getAzureBlobClient(AzureConnection.java:136) at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.getContainer(AzureBlobStorageFSProvider.java:145) at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.write(AzureBlobStorageFSProvider.java:653) ... 5 more
The settings of the connection and the event server are in the attachments.
Could you help me ?
Best regards,
Hi @Erylis
,
Just to confirm, does this connection work outside of Event Server? For example, can you create a dataset with the connection?
If it works outside of Event Server, then this is a known bug with the version of DSS that you're using. Event Server is unable to decrypt the credentials when using an Azure connection with a shared key.
You can fix the issue by upgrading to a newer version of DSS. The issue was fixed in DSS 9.0.4.
Thanks,
Zach
HI @ZachM
,
Thank you for your answer.
The connection work outside of Event Server so it should be the bug you mentionned.
Do you have a link to the identified bug ?
Best Regards,