Change Precision of Double Number
dwitkin
Registered Posts: 4 ✭✭✭✭
Hello. I have numbers in a dataset that look like this: 1.6199999999999974
I want to reduce the precision to 3 decimal places. I saw there is a format function for strings, but didn't see anything similar for numbers. What is the best way to reduce the precision to 3 decimal places? Do I need to use a script for that? If so, can you help me with what it might look like?
Thanks for your help.
I want to reduce the precision to 3 decimal places. I saw there is a format function for strings, but didn't see anything similar for numbers. What is the best way to reduce the precision to 3 decimal places? Do I need to use a script for that? If so, can you help me with what it might look like?
Thanks for your help.
Tagged:
Best Answer

Hi,
Use the "Formula" processor in data preparation, with a formula like:
format("%.3f", my_column_name)DSS formula use the Java variant of format strings:
https://docs.oracle.com/javase/7/docs/api/java/util/Formatter.html#summaryFor more information about formulas, see:
https://www.dataiku.com/learn/guide/code/misc/formulamaster.html
http://doc.dataiku.com/dss/latest/advanced/formula.html
Answers

It is helpful. Thanks Clement.