python in jupyter notebooks - make the %autoreload magic work!
Tanguy
Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Dataiku DSS Developer, Neuron 2023 Posts: 124 Neuron
As anything else, developing a python module in a library area needs iteration.
In this case, the auto reload magic command in jupyter notebook is awesome: one does not have to relaunch his notebook anymore to refresh code changes in his python module (thus avoiding time consuming preprocessing tasks, like loading heavy datasets).
It would greatly improve the python developer's experience to make this command work in dataiku.
Tagged:
Comments
-
-
Tanguy Dataiku DSS Core Designer, Dataiku DSS & SQL, Dataiku DSS ML Practitioner, Dataiku DSS Core Concepts, Neuron, Dataiku DSS Adv Designer, Registered, Dataiku DSS Developer, Neuron 2023 Posts: 124 Neuron
It seems working with the global shared code provides a workaround. Indeed, jupyter notebooks seem to work with the current version of the global shared code (not a snapshot of the version when the notebook was launched), so you could temporarily develop in this area before moving your modules into the project library.