hive.ql parse ParseException

sunith992

can anyone please help on the below error, its happening frequently while running the recipes

Oops: an unexpected error occurred

Error while compiling statement: FAILED: ParseException line 13:18 Failed to recognize predicate ','. Failed rule: '[., :] can not be used in column name in create table statement.' in column specification, caused by: HiveSQLException: Error while compiling statement: FAILED: ParseException line 13:18 Failed to recognize predicate ','. Failed rule: '[., :] can not be used in column name in create table statement.' in column specification, caused by: RuntimeException: org.apache.hadoop.hive.ql.parse.ParseException:line 13:18 Failed to recognize predicate ','. Failed rule: '[., :] can not be used in column name in create table statement.' in column specification

Please see our options for getting help

HTTP code: 500, type: org.apache.hive.service.cli.HiveSQLException

Catalina

Hi @sunith992

Based on the error snippet that you provided, it seems that there is an unsupported character in the column name in the create table statement. This issue occurs because Hive does not allow certain characters in columns thus resulting in the create table failing.

You will need to modify your pyspark recipe to remove any characters as explained in the error message:

'[., :] can not be used in column name in create table statement.'

If this doesn't help, I would suggest to open a support ticket on support.dataiku.com and provide job diagnosis.