hive.ql parse ParseException

Options
sunith992
sunith992 Dataiku DSS Core Designer, Registered Posts: 20 ✭✭✭✭

can anyone please help on the below error, its happening frequently while running the recipes

Oops: an unexpected error occurred

Error while compiling statement: FAILED: ParseException line 13:18 Failed to recognize predicate ','. Failed rule: '[., :] can not be used in column name in create table statement.' in column specification, caused by: HiveSQLException: Error while compiling statement: FAILED: ParseException line 13:18 Failed to recognize predicate ','. Failed rule: '[., :] can not be used in column name in create table statement.' in column specification, caused by: RuntimeException: org.apache.hadoop.hive.ql.parse.ParseException:line 13:18 Failed to recognize predicate ','. Failed rule: '[., :] can not be used in column name in create table statement.' in column specification

Please see our options for getting help

HTTP code: 500, type: org.apache.hive.service.cli.HiveSQLException

Tagged:

Answers

  • Catalina
    Catalina Dataiker, Dataiku DSS Core Designer, Registered Posts: 135 Dataiker
    Options
    Based on the error snippet that you provided, it seems that there is an unsupported character in the column name in the create table statement. This issue occurs because Hive does not allow certain characters in columns thus resulting in the create table failing.
    You will need to modify your pyspark recipe to remove any characters as explained in the error message:
    '[., :] can not be used in column name in create table statement.'
    If this doesn't help, I would suggest to open a support ticket on support.dataiku.com and provide job diagnosis.
Setup Info
    Tags
      Help me…