python in jupyter notebooks - make the %autoreload magic work!

Tanguy
Tanguy Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Dataiku DSS Developer, Neuron 2023, Circle Member Posts: 143 Neuron

As anything else, developing a python module in a library area needs iteration.

In this case, the auto reload magic command in jupyter notebook is awesome: one does not have to relaunch his notebook anymore to refresh code changes in his python module (thus avoiding time consuming preprocessing tasks, like loading heavy datasets).

It would greatly improve the python developer's experience to make this command work in dataiku.

5
5 votes

New · Last Updated

Comments

  • Tanguy
    Tanguy Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Dataiku DSS Developer, Neuron 2023, Circle Member Posts: 143 Neuron

    It seems working with the global shared code provides a workaround. Indeed, jupyter notebooks seem to work with the current version of the global shared code (not a snapshot of the version when the notebook was launched), so you could temporarily develop in this area before moving your modules into the project library.

Setup Info
    Tags
      Help me…