Automated table definition not creating long enough varchar fields

stainlessteelra · September 26

Anyone have an idea on why my tables are creating with only varchar(18) when the query produces text longer than that?

Getting this error:

ERROR: Value too long for character type Detail: ----------------------------------------------- error: Value too long for character type code: 8001 context: Value too long for type character varying(18) query: 612775556 location: string.cpp:219 process: padbmaster [pid=1073781440

I can fix it by manually redefining the table definitions but hoping to get to root cause to try to fix.

Turribeach · September 26

Where exactly is this error from? string.cpp implies this is C++ code failing. The Dataiku Server is Java based not C++…

Alexandru · September 30

Hi,
To me, the error looks like it is coming from an SQL database, which may be using C++.

The length is only defined during the initial schema creation DSS.

You can either modify the schema of the output datasets or delete it and let it be re-created when the recipes run. It should detect an appropriate length.

1) Modify lenght

Thanks

stainlessteelra · October 1

Thanks Alexandru,

I was expecting that DSS queried the data prior (a sample) to defining the output dataset schema to determine a length for the varchar columns.

Maybe i'm incorrect, but in the past i don't remember having to specify the varchar length for each column.

Thanks!

Alexandru · October 1

This behavior can vary depending on the database type. Can you confirm what database you are using?

stainlessteelra · October 2

Redshift

Automated table definition not creating long enough varchar fields

Comments

Categories

Setup Info

Tags