disabling Update output schemas in Python Scenario

tpelczarski
tpelczarski Registered Posts: 2

Hi how do I disable the option that updates output schema in a Python scenario? Can't find the option in the API reference. Would be equivalent of circled below. Thanks

Operating system used: Windows

Operating system used: Windows

Answers

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,252 Neuron

    Do you have a Python step in a Scenario or a Python Scenario script? What exactly is your Python code do? The update putput schema option is for build steps.

  • tpelczarski
    tpelczarski Registered Posts: 2

    Hi I have a series of steps like that:

    scenario.build_dataset('dataset_name,build_mode='NON_RECURSIVE_FORCED_BUILD')
    

    in case of some, I want to prevent the updating of output's schema.

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,252 Neuron

    I don't believe it's possible to specify this in the scenario.build_dataset() API call. The bigger question is why are you using these hardcoded build steps like this? Why not use regular build steps? Why not use build recursive where appropiate to avoid having to put every dataset name? Having Python code with hardcoded dataset names will mean that if the dataset is renamed or deleted from the flow the scenario will fail.

Setup Info
    Tags
      Help me…