Override to Standard "Duck Typing" of Variables in DSS

tgb417
tgb417 Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Frontrunner 2022 Finalist, Frontrunner 2022 Winner, Dataiku Frontrunner Awards 2021 Participant, Frontrunner 2022 Participant, Neuron 2023 Posts: 1,598 Neuron

User Story:

As a user that is trying to automate the gathering of data from external data sources with Scenarios. I would like to be able to manually override the data storage type that is dynamically selected each time a scenario re-populates a dataset. Some times depending on the values produced by the source recipe a data storage type is changed, this caused Schema challenges breaking the ability to run the Scenario reliably. The value of this storage override would be to allow more reliable scenario operations.

Conditions of Satisfaction (COS):

  • The current default behavior of "Duck Typing" columns should remain. This should be treated as an advanced override.

Notes:

In my case I've noticed this particularly with the API Connect plugin, when the first data element is an error and missing a value in the integer column. The default for DSS seems then to be to make the column a float, when in the past it was correctly identified as a Int.

3
3 votes

New · Last Updated

Setup Info
    Tags
      Help me…