Hive arrays in Analysis
ubethke
Registered Posts: 21 ✭✭✭✭
Hi.
I have imported a Hive table through the command line utility. There are various arrays/lists/maps in this table. It seems that DSS does not support this at the moment.
Are there any plans to support it?
Is there a workaround
Thanks
Uli
I have imported a Hive table through the command line utility. There are various arrays/lists/maps in this table. It seems that DSS does not support this at the moment.
Are there any plans to support it?
Is there a workaround
Thanks
Uli
Tagged:
Answers
-
Hi Uli,
I'm assuming your tables are stored as CSV in Hive.
This is actually a bug in the import tool. DSS supports Hive complex types (arrays, maps, ...) but the import tool fails to set the proper setting. Go to the imported dataset settings, and in the CSV format parameters, set the "arrayMapFormat" parameter to Hive.
Save, go back to Explore, and you should see your complex types.
Thanks for reporting this!