Sign up to take part
Registered users can ask their own questions, contribute to discussions, and be part of the Community!
We have a scenario where the transformed dataset is exported to SharePoint online folders, email reports and flat downloads from end users. We found that certain values in a text field gets changed automatically as shown below,
Actual Value: 32005195642052503618
After Export: 32005195642052500000 (Last Four Characters are changed to 0)
This happens when the value has more that 14 numeric characters in text field.
The intermediate datasets are in Snowflake and we use In-database (SQL) engine for recipe's.
PFA Screenshot from Dataiku and Excel Download.
Operating system used: Windows 64 bit
This may be an issue with floating-point arithmetics, have a look at this post:
If the field is an account number then make sure it is defined as a string/text field from the time you input it into Dataiku to the time you output it.
I don't think you are ingesting the field as a string otherwise you wouldn't be missing characters. I can see on your Dataiku screen shot that someone locked the meaning of the column as Text. That means somewhere in your flow Dataiku must be coming up with the meaning as double which means the field is not a string. So to be sure that you ingest this field as a text make sure you apply a "to string" function in your data source so that Dataiku gets this field from your data source as a string. Then make sure it remains a string all the way through your flow.