Discover all of the brand-new features and improvements to existing capabilities in the Dataiku 11.3 updateLET'S GO

DSS Event server setup - Destination

Solved!
Erylis
Level 2
DSS Event server setup - Destination

Hello,

I've setting up an Event server wich is suppose to write on an Azure Blob Storage.

The server is  not able to write and the foolowing error show up :

 

[2022/10/11-13:17:53.611] [QueueHandler-target-ConnectionPathTarget-1] [INFO] [dku.datasets.bloblike]  - Writing base=/apicall/2022/10/11/ split=0 chunk=0 -> target = /apicall/2022/10/11//out-s0-2022-10-11-13-17-53-611.gz
[2022/10/11-13:17:53.611] [QueueHandler-target-ConnectionPathTarget-1] [WARN] [dku.eventserver.queue]  - Processing error
java.io.IOException: Failed to write /apicall/2022/10/11//out-s0-2022-10-11-13-17-53-611.gz
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.tryCode(AzureBlobStorageFSProvider.java:136)
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.write(AzureBlobStorageFSProvider.java:668)
        at com.dataiku.dip.datasets.fs.BlobLikeResplitOutputWriter.init(BlobLikeResplitOutputWriter.java:64)
        at com.dataiku.dip.eventserver.targets.ConnectionPathTarget.getOrOpenPartition(ConnectionPathTarget.java:252)
        at com.dataiku.dip.eventserver.targets.ConnectionPathTarget.process(ConnectionPathTarget.java:288)
        at com.dataiku.dip.eventserver.ProcessingQueue$QueueHandler.run(ProcessingQueue.java:54)
        at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.IllegalArgumentException: The String is not a valid Base64-encoded string.
        at com.dataiku.dss.shadelib.com.microsoft.azure.storage.core.Base64.decode(Base64.java:88)
        at com.dataiku.dss.shadelib.com.microsoft.azure.storage.StorageCredentialsAccountAndKey.<init>(StorageCredentialsAccountAndKey.java:81)
        at com.dataiku.dip.connections.AzureConnection.getAzureBlobCredentials(AzureConnection.java:204)
        at com.dataiku.dip.connections.AzureConnection.getAzureBlobClient(AzureConnection.java:136)
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.getContainer(AzureBlobStorageFSProvider.java:145)
        at com.dataiku.dip.datasets.fs.AzureBlobStorageFSProvider.write(AzureBlobStorageFSProvider.java:653)
        ... 5 more

 

The settings of the connection and the event server are in the attachments.

Could you help me ?

Best regards,

0 Kudos
1 Solution
ZachM
Dataiker

Hi @Erylis ,

Just to confirm, does this connection work outside of Event Server? For example, can you create a dataset with the connection?

If it works outside of Event Server, then this is a known bug with the version of DSS that you're using. Event Server is unable to decrypt the credentials when using an Azure connection with a shared key.

You can fix the issue by upgrading to a newer version of DSS. The issue was fixed in DSS 9.0.4.

 

Thanks,

Zach

 

View solution in original post

0 Kudos
2 Replies
ZachM
Dataiker

Hi @Erylis ,

Just to confirm, does this connection work outside of Event Server? For example, can you create a dataset with the connection?

If it works outside of Event Server, then this is a known bug with the version of DSS that you're using. Event Server is unable to decrypt the credentials when using an Azure connection with a shared key.

You can fix the issue by upgrading to a newer version of DSS. The issue was fixed in DSS 9.0.4.

 

Thanks,

Zach

 

0 Kudos
Erylis
Level 2
Author

HI @ZachM,

Thank you for your answer.

The connection work outside of Event Server so it should be the bug you mentionned. 

Do you have a link to the identified bug ?

Best Regards,

0 Kudos