How to replace scientific notation
Bonjour,
I have a dataset with scientif value , i can't find the solution to convert them in numeric.
Thanks
Answers
-
Maybe using the "Formula" processor? See here.
-
Hi,
is there any update on this topic? The scientific value appears in SQL notebooks as well as when connecting to the SQL DB. Even though in the SQL DB the value appears correctly.
In my case, the prepare recipe with formula does not affect the output formatting.
Thank you for any help!
Best regards,
Romana
-
CoreyS Dataiker Alumni, Dataiku DSS Core Designer, Dataiku DSS Core Concepts, Registered Posts: 1,150 ✭✭✭✭✭✭✭✭✭
Hi @Romana
we actually wrote a Knowledge Base article on this topic: How to remove scientific notation in a column.I hope this helps!
-
Hi @CoreyS
,thank you for your reply. Unfortunately this does not work..
In the prepare recipe after applying formula the value looks OK "54555139.94" but in the actual output of the prepare recipe the value is shown again as "5.455513994E7" . The formula I use is: "format("%.2f", numval("column name"))"
Also this does not really solve the issue when I want to explore values stored in SQL DB and I only want to create a new dataset without any visual recipes.
-
Can confirm that this solution does not work, I am having the same problem as Romana.
-
CoreyS Dataiker Alumni, Dataiku DSS Core Designer, Dataiku DSS Core Concepts, Registered Posts: 1,150 ✭✭✭✭✭✭✭✭✭
@Romana
@Joeiku
Here is another thread where an answer to your issues should apply. I've spoken with Makoto and he confirmed that this solution should apply: https://community.dataiku.com/t5/Using-Dataiku-DSS/Scientific-Notation-not-removed-by-format-function/m-p/12098/highlight/true#M5443 -
Hi all,
I hear your frustration. The knowledge base article has actually been updated to specify that the storage type would need to be changed to string in the output dataset in order for the regular number format to persist visually (otherwise you only see within the prepare recipe). I'm aware that this is definitely not an ideal solution, but unfortunately that's the best solution now.
Feel free to submit a feature request on this topic here so that the product team is aware of your interest in changing the default numerical format from scientific notation to standard number format.
Katie
-
tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,598 Neuron
I’d +1 the sentiment that this is not an optimal situation for most businesses. Particularly if the value is fully expressed in the underlying storage.