jupyter notebook support for scenario python code.

Options
Jason
Jason Registered Posts: 29 ✭✭✭✭✭

I am looking at developing some python code to help move a scenario along. There is no good way (that I can find) to properly test python code in a scenario. The UI itself doesn't have a mechanism to run Jupyter Notebooks, and I cannot access it through the Pycharm plugin either. I'm not sure how others do it, but I need to be able to inspect the objects I am using. Right now I'm just guessing at their contents and testing by triggering the step in the scenario and looking at the logs. Not a very efficient way to go.

3
3 votes

New · Last Updated

Comments

  • Marlan
    Marlan Neuron 2020, Neuron, Registered, Dataiku Frontrunner Awards 2021 Finalist, Neuron 2021, Neuron 2022, Dataiku Frontrunner Awards 2021 Participant, Neuron 2023 Posts: 317 Neuron
    Options

    Hi @Jason
    ,

    Good question... I don't have an answer. I've done the same thing you describe which is to print debugging information and check the logs. I haven't found that to be too too painful but yes it certainly would be great if there were an easier/quicker way.

    Marlan

  • Turribeach
    Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 1,757 Neuron
    Options

    Agreed this is a pain. It gets even worst if you use functions because even after you copy/paste the code into a notebook a function failing will naturally clear all the local variables when it raises the exception so unless you have good logging you have to change the function to see what went wrong. And here is another for Scenarios which I am sure you suffer too:

    https://community.dataiku.com/t5/Product-Ideas/Display-user-id-on-Scenario-Last-Runs-screen/idi-p/35985

Setup Info
    Tags
      Help me…