How to replace scientific notation

hagdouglas
hagdouglas Registered Posts: 1 ✭✭✭✭

Bonjour,

I have a dataset with scientif value , i can't find the solution to convert them in numeric.

Thanks

Answers

  • jereze
    jereze Alpha Tester, Dataiker Alumni Posts: 190 ✭✭✭✭✭✭✭✭

    Maybe using the "Formula" processor? See here.

  • Romana
    Romana Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Registered Posts: 15 ✭✭✭✭

    Hi,

    is there any update on this topic? The scientific value appears in SQL notebooks as well as when connecting to the SQL DB. Even though in the SQL DB the value appears correctly.

    In my case, the prepare recipe with formula does not affect the output formatting.

    Thank you for any help!

    Best regards,

    Romana

  • CoreyS
    CoreyS Dataiker Alumni, Dataiku DSS Core Designer, Dataiku DSS Core Concepts, Registered Posts: 1,150 ✭✭✭✭✭✭✭✭✭

    Hi @Romana
    we actually wrote a Knowledge Base article on this topic: How to remove scientific notation in a column.

    I hope this helps!

  • Romana
    Romana Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Registered Posts: 15 ✭✭✭✭

    Hi @CoreyS
    ,

    thank you for your reply. Unfortunately this does not work..

    In the prepare recipe after applying formula the value looks OK "54555139.94" but in the actual output of the prepare recipe the value is shown again as "5.455513994E7" . The formula I use is: "format("%.2f", numval("column name"))"

    Also this does not really solve the issue when I want to explore values stored in SQL DB and I only want to create a new dataset without any visual recipes.

  • Joeiku
    Joeiku Registered Posts: 5 ✭✭✭

    Can confirm that this solution does not work, I am having the same problem as Romana.

  • CoreyS
    CoreyS Dataiker Alumni, Dataiku DSS Core Designer, Dataiku DSS Core Concepts, Registered Posts: 1,150 ✭✭✭✭✭✭✭✭✭

    @Romana
    @Joeiku
    Here is another thread where an answer to your issues should apply. I've spoken with Makoto and he confirmed that this solution should apply: https://community.dataiku.com/t5/Using-Dataiku-DSS/Scientific-Notation-not-removed-by-format-function/m-p/12098/highlight/true#M5443

  • Katie
    Katie Dataiker, Registered, Product Ideas Manager Posts: 106 Dataiker

    Hi all,

    I hear your frustration. The knowledge base article has actually been updated to specify that the storage type would need to be changed to string in the output dataset in order for the regular number format to persist visually (otherwise you only see within the prepare recipe). I'm aware that this is definitely not an ideal solution, but unfortunately that's the best solution now.

    Feel free to submit a feature request on this topic here so that the product team is aware of your interest in changing the default numerical format from scientific notation to standard number format.

    Katie

  • tgb417
    tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,598 Neuron

    @ktgross15

    I’d +1 the sentiment that this is not an optimal situation for most businesses. Particularly if the value is fully expressed in the underlying storage.

Setup Info
    Tags
      Help me…