SalesForce Plugin - data typed as Object breaks external storage

alundavid
Level 3
SalesForce Plugin - data typed as Object breaks external storage

Hi community,

I want to use the SalesForce Plugin v.1.2.1 to write data to SalesForce.

Using the SalesForce recipe, I have successfully uploaded sample data. 

Currently, the output dataset is stored in as "filesystem managed", and everything works fine. However, I notice that the "data" column in the output is of type "object". When I use an output dataset with external storage (either Hive or Athena/Presto), I get an error  because of the column type.

Capture.PNG

For various reasons it is problematic for me to use the dss file system to store this data, so I do need to find a way to use external storage here.

I'd appreciate any help anyone can offer. Thanks in advance.


Operating system used: ec2

0 Kudos
1 Reply
AlexT
Dataiker

Hi,

The error show that object type is not supported for Hive. To overcome this you will need to change the column type from object to string in the schema of your output dataset this should allow you to use Hive/Presto.

 

Screenshot 2022-08-02 at 11.26.57.png

Let me know if that helps. 

 

0 Kudos

Labels

?

Setup info

?
A banner prompting to get Dataiku