Schema management issue in Dataiku
Hi,
Here is a problem I'm encountering with Dataiku regarding the management of table schemas during their creation and modification.
I have an "input" table that contains data in varchar(1) format.
I'm using a "prepare" recipe that creates a copy of the "input" table into the "output" table. Dataiku automatically generates the "output" table with data in varchar(1) format = OK.
Later, the "input" table underwent a change: the data now has a varchar(3) format.
If I re-run the "prepare" recipe, it fails even though I force the schema update because the data in the "output" table remains in varchar(1) format. = KO
In the table settings, I change the "table creation mode" to manual and modify the varchar(1) format to varchar(3).
The recipe works and the data is loaded = OK
If now in the settings, I switch the "table creation mode" back to automatic, Dataiku regenerates the table by reverting to varchar(1) = KO ??
It seems to me that this is not adequate behavior: the input data is in format 3, the table was dropped, the processing worked in format 3 in manual mode. Why does it remember format 1 in automatic mode ?
Thank you for your help