ML-assisted Labeling install failed

[Herve]

Creation result

Errors were encountered

• ERROR
  ERR_CODEENV_CREATION_FAILED

  Environment creation failed

  /home/hblanc/DATA_DIR/code-envs/python/plugin_ml-assisted-labeling_managed_2/bin/python failed (exit code: 1)

    creating build/lib.linux-x86_64-3.6/tests/preprocessing    copying tests/preprocessing/test_csv_generator.py -> build/lib.linux-x86_64-3.6/tests/preprocessing    copying tests/preprocessing/test_generator.py -> build/lib.linux-x86_64-3.6/tests/preprocessing    copying tests/preprocessing/__init__.py -> build/lib.linux-x86_64-3.6/tests/preprocessing    creating build/lib.linux-x86_64-3.6/tests/layers    copying tests/layers/test_filter_detections.py -> build/lib.linux-x86_64-3.6/tests/layers    copying tests/layers/test_misc.py -> build/lib.linux-x86_64-3.6/tests/layers    copying tests/layers/__init__.py -> build/lib.linux-x86_64-3.6/tests/layers    creating build/lib.linux-x86_64-3.6/tests/utils    copying tests/utils/test_anchors.py -> build/lib.linux-x86_64-3.6/tests/utils    copying tests/utils/test_transform.py -> build/lib.linux-x86_64-3.6/tests/utils    copying tests/utils/__init__.py -> build/lib.linux-x86_64-3.6/tests/utils    creating build/lib.linux-x86_64-3.6/tests/models    copying tests/models/test_densenet.py -> build/lib.linux-x86_64-3.6/tests/models    copying tests/models/__init__.py -> build/lib.linux-x86_64-3.6/tests/models    copying tests/models/test_mobilenet.py -> build/lib.linux-x86_64-3.6/tests/models    creating build/lib.linux-x86_64-3.6/keras_retinanet/backend    copying keras_retinanet/backend/cntk_backend.py -> build/lib.linux-x86_64-3.6/keras_retinanet/backend    copying keras_retinanet/backend/dynamic.py -> build/lib.linux-x86_64-3.6/keras_retinanet/backend    copying keras_retinanet/backend/common.py -> build/lib.linux-x86_64-3.6/keras_retinanet/backend    copying keras_retinanet/backend/theano_backend.py -> build/lib.linux-x86_64-3.6/keras_retinanet/backend    copying keras_retinanet/backend/__init__.py -> build/lib.linux-x86_64-3.6/keras_retinanet/backend    copying keras_retinanet/backend/tensorflow_backend.py -> build/lib.linux-x86_64-3.6/keras_retinanet/backend    creating build/lib.linux-x86_64-3.6/keras_retinanet/preprocessing    copying keras_retinanet/preprocessing/generator.py -> build/lib.linux-x86_64-3.6/keras_retinanet/preprocessing    copying keras_retinanet/preprocessing/pascal_voc.py -> build/lib.linux-x86_64-3.6/keras_retinanet/preprocessing    copying keras_retinanet/preprocessing/csv_generator.py -> build/lib.linux-x86_64-3.6/keras_retinanet/preprocessing    copying keras_retinanet/preprocessing/coco.py -> build/lib.linux-x86_64-3.6/keras_retinanet/preprocessing    copying keras_retinanet/preprocessing/kitti.py -> build/lib.linux-x86_64-3.6/keras_retinanet/preprocessing    copying keras_retinanet/preprocessing/__init__.py -> build/lib.linux-x86_64-3.6/keras_retinanet/preprocessing    copying keras_retinanet/preprocessing/open_images.py -> build/lib.linux-x86_64-3.6/keras_retinanet/preprocessing    creating build/lib.linux-x86_64-3.6/keras_retinanet/layers    copying keras_retinanet/layers/filter_detections.py -> build/lib.linux-x86_64-3.6/keras_retinanet/layers    copying keras_retinanet/layers/__init__.py -> build/lib.linux-x86_64-3.6/keras_retinanet/layers    copying keras_retinanet/layers/_misc.py -> build/lib.linux-x86_64-3.6/keras_retinanet/layers    creating build/lib.linux-x86_64-3.6/keras_retinanet/utils    copying keras_retinanet/utils/transform.py -> build/lib.linux-x86_64-3.6/keras_retinanet/utils    copying keras_retinanet/utils/image.py -> build/lib.linux-x86_64-3.6/keras_retinanet/utils    copying keras_retinanet/utils/colors.py -> build/lib.linux-x86_64-3.6/keras_retinanet/utils    copying keras_retinanet/utils/eval.py -> build/lib.linux-x86_64-3.6/keras_retinanet/utils    copying keras_retinanet/utils/anchors.py -> build/lib.linux-x86_64-3.6/keras_retinanet/utils    copying keras_retinanet/utils/keras_version.py -> build/lib.linux-x86_64-3.6/keras_retinanet/utils    copying keras_retinanet/utils/config.py -> build/lib.linux-x86_64-3.6/keras_retinanet/utils    copying keras_retinanet/utils/coco_eval.py -> build/lib.linux-x86_64-3.6/keras_retinanet/utils    copying keras_retinanet/utils/model.py -> build/lib.linux-x86_64-3.6/keras_retinanet/utils    copying keras_retinanet/utils/visualization.py -> build/lib.linux-x86_64-3.6/keras_retinanet/utils    copying keras_retinanet/utils/__init__.py -> build/lib.linux-x86_64-3.6/keras_retinanet/utils    creating build/lib.linux-x86_64-3.6/keras_retinanet/models    copying keras_retinanet/models/retinanet.py -> build/lib.linux-x86_64-3.6/keras_retinanet/models    copying keras_retinanet/models/resnet.py -> build/lib.linux-x86_64-3.6/keras_retinanet/models    copying keras_retinanet/models/vgg.py -> build/lib.linux-x86_64-3.6/keras_retinanet/models    copying keras_retinanet/models/densenet.py -> build/lib.linux-x86_64-3.6/keras_retinanet/models    copying keras_retinanet/models/__init__.py -> build/lib.linux-x86_64-3.6/keras_retinanet/models    copying keras_retinanet/models/mobilenet.py -> build/lib.linux-x86_64-3.6/keras_retinanet/models    creating build/lib.linux-x86_64-3.6/keras_retinanet/bin    copying keras_retinanet/bin/debug.py -> build/lib.linux-x86_64-3.6/keras_retinanet/bin    copying keras_retinanet/bin/train.py -> build/lib.linux-x86_64-3.6/keras_retinanet/bin    copying keras_retinanet/bin/evaluate.py -> build/lib.linux-x86_64-3.6/keras_retinanet/bin    copying keras_retinanet/bin/__init__.py -> build/lib.linux-x86_64-3.6/keras_retinanet/bin    copying keras_retinanet/bin/convert_model.py -> build/lib.linux-x86_64-3.6/keras_retinanet/bin    creating build/lib.linux-x86_64-3.6/keras_retinanet/callbacks    copying keras_retinanet/callbacks/eval.py -> build/lib.linux-x86_64-3.6/keras_retinanet/callbacks    copying keras_retinanet/callbacks/common.py -> build/lib.linux-x86_64-3.6/keras_retinanet/callbacks    copying keras_retinanet/callbacks/coco.py -> build/lib.linux-x86_64-3.6/keras_retinanet/callbacks    copying keras_retinanet/callbacks/__init__.py -> build/lib.linux-x86_64-3.6/keras_retinanet/callbacks    running build_ext    skipping 'keras_retinanet/utils/compute_overlap.c' Cython extension (up-to-date)    building 'keras_retinanet.utils.compute_overlap' extension    creating build/temp.linux-x86_64-3.6    creating build/temp.linux-x86_64-3.6/keras_retinanet    creating build/temp.linux-x86_64-3.6/keras_retinanet/utils    x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -g -fdebug-prefix-map=/build/python3.6-yK1u7P/python3.6-3.6.12=. -specs=/usr/share/dpkg/no-pie-compile.specs -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.6m -I/home/hblanc/DATA_DIR/code-envs/python/plugin_ml-assisted-labeling_managed_2/include/python3.6m -I/home/hblanc/DATA_DIR/code-envs/python/plugin_ml-assisted-labeling_managed_2/lib/python3.6/site-packages/numpy/core/include -c keras_retinanet/utils/compute_overlap.c -o build/temp.linux-x86_64-3.6/keras_retinanet/utils/compute_overlap.o    keras_retinanet/utils/compute_overlap.c:4:10: fatal error: Python.h: No such file or directory        4 | #include "Python.h"          |          ^~~~~~~~~~    compilation terminated.    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1    ----------------------------------------    Running setup.py install for keras-retinanet: finished with status 'error'ERROR: Command errored out with exit status 1: /home/hblanc/DATA_DIR/code-envs/python/plugin_ml-assisted-labeling_managed_2/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-anmninkc/keras-retinanet_eff9b14678734031ad11adac2a8389d8/setup.py'"'"'; __file__='"'"'/tmp/pip-install-anmninkc/keras-retinanet_eff9b14678734031ad11adac2a8389d8/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-cq1qyrs3/install-record.txt --single-version-externally-managed --compile --install-headers /home/hblanc/DATA_DIR/code-envs/python/plugin_ml-assisted-labeling_managed_2/include/site/python3.6/keras-retinanet Check the logs for full command output.

[sergeyd]

Hi @Herve 

The root cause is:

fatal error: Python.h: No such file or directory

You will need to install python3-devel (as your code-env is Python3 based) OS package to get this fixed:

https://doc.dataiku.com/dss/latest/code-envs/troubleshooting.html#python-h-not-found

[Herve · Accepted solution]

I actually needed a bit more to get this to work :

sudo apt install python3.6-dev gcc build-essential

[sergeyd]

Hi @Herve 

If you have Ubuntu (Debian), yes, you need to install python3.6-dev OS package but from the stacktrace we cannot guess what OS you are running. gcc and build-essential might require later on during compilation when python.h is already available. Still, this cannot be seen/predicted from the original traceback. 

Anyway, glad you were able to find the solution. 

[Herve]

Hi Sergey,

Your input was really helpful, I did not meant to say otherwise.

Thanks a lot

Herve