Prepare Recipe infering column data types on creation
Hi,
when i create a new prepare recipe, it changes the type of my columns
input:
output:
Is this the desired behavior? This can cause data loss.
Regards
Answers
-
Hi,
We confirm that this is the desired behavior. DSS has heuristics in place to limit risks of data loss, for example by not using numerical types if there are zero-leading values.
We're thinking about making this configurable in future releases.
-
But next time when i run the recipe, as the column types were changed from string to int/double, if i receive alphanumeric codes and versions, they will be lost.
-
Hi,
Storage type assignment is only performed once per column, when the column is originally created.
We never update storage types when running a recipe, and in the specific case of the prepare recipe, we also don't update storage types when designing after the initial column creation.
-
Please, we need this to be configurable in future releases, it is changing all phone fields to numeric, showing warnings at execution time, and losing data.
