Range for numeric data types in dataiku

NN
NN Neuron, Registered, Neuron 2022, Neuron 2023 Posts: 145 Neuron

Hi Team,
Is there any documentation or note that can tell me the numeric range for data types in dataiku.
For example in sql server tinyint has a range of 0-255

Is this the same for dataiku as well ?

Thank you...

Tagged:

Answers

  • JuanE
    JuanE Dataiker, Registered Posts: 45 Dataiker

    Hello,

    I believe this is what you are looking for:

    https://doc.dataiku.com/dss/latest/schemas/definitions.html#storage-types

    Let me know if that helps and if you have any further questions.

  • NN
    NN Neuron, Registered, Neuron 2022, Neuron 2023 Posts: 145 Neuron

    Thankyou @JuanE
    ..
    So i noticed the difference was that on MS sqlserver tinyint is an unsigned variable with a range 0-255

    On dataiku tinyint is a signed integer with range -128 to 127

    Now the challenge i face is that when i pull data from an MS SQL server into dataiku using the SQL Code recipe dataiku reads the Ms SQL tinyint column as dataiku tinyint column and hence any value above 127 which is stored in MS SQL gets dropped with OOR message as below.
    file=unk line=2 column=col1 type=TINYINT val=131

    Is there anyway that i can define that any tinyint from mssql server be read as smallint instead ?
    or do i have to cast each tinyint column i read to avoid this issue

  • JuanE
    JuanE Dataiker, Registered Posts: 45 Dataiker

    Hello,

    It is not clear to me what you are building. Would you please attach a diagnosis of the affected job? You can generate it by navigating to the appropriate job page and clicking on Actions > Download job diagnosis. If the resulting file is too large to be sent over email (>15 MB), you can use https://dl.dataiku.com to send it to us. However, please don't forget to send the automatically generated link after uploading this file. Thank you.

  • NN
    NN Neuron, Registered, Neuron 2022, Neuron 2023 Posts: 145 Neuron

    Hi @JuanE

    I could only attach a cleaned log of the recipe.

    the warnings in the log is the issue that i am referring to.

    In case if you would still need to entire diagnosis file then please do let me know.
    I shall close this post and will ask our admins to raise a ticket with dataiku and they can share the required diagnosis.

Setup Info
    Tags
      Help me…