Discover the winners & finalists of the 2022 Dataiku Frontrunner Awards!READ THEIR USE CASES

SQL Recipe: Error initializing column metadata

Solved!
tucel
Level 2
SQL Recipe: Error initializing column metadata

Hi!

I got an error message while trying to run a sql recipe to create a bigquery table from another ones. I tried the query on bigquery and it's working on there. I am curious about why the same query cannot work on sql recipe in dataiku. Error message:

Validation failed
Query failed: [Simba][BigQueryJDBCDriver](100078) Error initializing column metadata: Could not retrieve table schema information. , caused by: GeneralException: [Simba][BigQueryJDBCDriver](100078) Error initializing column metadata: Could not retrieve table schema information.

 I tried to create the table in bigquery and import it into dss in order to dss may see the table schema but nothing changed. 
Note: My query might be a little complex but bigquery can handle it. And I choosed the SQL Query option while creating a SQL recipe. Should not it run the query on bigquery engine directly?

0 Kudos
1 Solution
tucel
Level 2
Author

Hi, thanks for return!

After several attemps to fix the issue, I realized that SQL recipe could not handle the query with a declare method. I was declaring a variable before the query. After removing this declare method dss could run the recipe. So, issue has fixed 🙂

 Regards,

View solution in original post

3 Replies
fchataigner2
Dataiker

Hi,

the error seems to happen at validation time (which is done before the recipe run to compute the output column types), but the message itself is insufficient to pinpoint a cause. Maybe unsupported column types? You'd need to open a ticket on support.dataiku.com with a diagnostic of the instance, that you can generate in Administration > Maintenance > Diagnostic tool, and send to us via dl.dataiku.com

0 Kudos
tucel
Level 2
Author

Hi, thanks for return!

After several attemps to fix the issue, I realized that SQL recipe could not handle the query with a declare method. I was declaring a variable before the query. After removing this declare method dss could run the recipe. So, issue has fixed 🙂

 Regards,

CoreyS
Dataiker Alumni

Thank you for sharing your solution with the rest of the commmunity @tucel

Looking for more resources to help you use Dataiku effectively and upskill your knowledge? Check out these great resources: Dataiku Academy | Documentation | Knowledge Base

A reply answered your question? Mark as ‘Accepted Solution’ to help others like you!
0 Kudos