Hive arrays in Analysis

Options
ubethke
ubethke Registered Posts: 21 ✭✭✭✭
Hi.

I have imported a Hive table through the command line utility. There are various arrays/lists/maps in this table. It seems that DSS does not support this at the moment.

Are there any plans to support it?

Is there a workaround

Thanks

Uli

Answers

  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer, Registered Posts: 753 Dataiker
    Options
    Hi Uli,

    I'm assuming your tables are stored as CSV in Hive.

    This is actually a bug in the import tool. DSS supports Hive complex types (arrays, maps, ...) but the import tool fails to set the proper setting. Go to the imported dataset settings, and in the CSV format parameters, set the "arrayMapFormat" parameter to Hive.

    Save, go back to Explore, and you should see your complex types.

    Thanks for reporting this!
Setup Info
    Tags
      Help me…