Automated table definition not creating long enough varchar fields

stainlessteelra

Anyone have an idea on why my tables are creating with only varchar(18) when the query produces text longer than that?

Getting this error:

ERROR: Value too long for character type Detail: ----------------------------------------------- error: Value too long for character type code: 8001 context: Value too long for type character varying(18) query: 612775556 location: string.cpp:219 process: padbmaster [pid=1073781440

I can fix it by manually redefining the table definitions but hoping to get to root cause to try to fix.

Turribeach

Where exactly is this error from? string.cpp implies this is C++ code failing. The Dataiku Server is Java based not C++…

Alexandru

Hi,
To me, the error looks like it is coming from an SQL database, which may be using C++.

The length is only defined during the initial schema creation DSS.

You can either modify the schema of the output datasets or delete it and let it be re-created when the recipes run. It should detect an appropriate length.

1) Modify lenght

Thanks

stainlessteelra

Thanks Alexandru,

I was expecting that DSS queried the data prior (a sample) to defining the output dataset schema to determine a length for the varchar columns.

Maybe i'm incorrect, but in the past i don't remember having to specify the varchar length for each column.

Thanks!

Alexandru

This behavior can vary depending on the database type. Can you confirm what database you are using?

stainlessteelra

Redshift