Python environment creation failed (time-series forecast)
Hi,
When I try to set up the time series forecast plugin I get the following error. I tried to re-create and update by rebuild env but still unsolved.
Thank you for all your help already.
Answers
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,212 DataikerHi,
Welcome to the Dataiku Community.
Could please try to installing the following dependencies and try rebuilding the env again.
For yum (CentOS, RHEL...):
sudo yum install python3-devel
For Ubuntu :
sudo apt-get install python3-dev
-
Hello, I also have trouble creating the environment, i've attached the error log. i've tried running
sudo apt-get install python3-dev
but it is already correctly installed.
first error in the attached file is (see complete error log in attachment):
Collecting ujson~=1.35 Using cached ujson-1.35.tar.gz (192 kB) ERROR: Command errored out with exit status 1: command: /home/dataiku/dss_data/code-envs/python/plugin_timeseries-forecast_managed_2/bin/python -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-q4i56dyb/ujson_17183858bf5345b5b96d93bbf012e266/setup.py'"'"'; __file__='"'"'/tmp/pip-install-q4i56dyb/ujson_17183858bf5345b5b96d93bbf012e266/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-pt2h5zzq cwd: /tmp/pip-install-q4i56dyb/ujson_17183858bf5345b5b96d93bbf012e266/ Complete output (12 lines): running bdist_wheel running build running build_ext building 'ujson' extension creating build creating build/temp.linux-x86_64-3.6 creating build/temp.linux-x86_64-3.6/python creating build/temp.linux-x86_64-3.6/libCollecting hijri-converter Downloading hijri_converter-2.1.3-py3-none-any.whl (14 kB)Collecting korean-lunar-calendar Using cached korean_lunar_calendar-0.2.1-py3-none-any.whl (8.0 kB)Building wheels for collected packages: ujson Building wheel for ujson (setup.py): started Building wheel for ujson (setup.py): finished with status 'error' Running setup.py clean for ujsonFailed to build ujson
do you have any idea how to solve this?
thanks
Xavier
-
Hello,
does anyone has an idea to solve this issue?
thanks!
Xavier
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,212 Dataiker
Hi Xavier,
Looking at the error it seems like the gcc compiler is failing to install ujson.
It could be a bug in the kernel that looks similar to :
https://bugs.launchpad.net/ubuntu/+source/python3.6/+bug/1768644
Suggests a workaround would be to run :
sudo apt-get install -y dpkg-dev
Let me know if that helps.
-
Hello @AlexT
,thank you for your answer; it really looks like the issue you're mentioning and I tried your command.
I still have the bug, which seems to be around the build of the wheel for ujson which is failing for some reason
Building wheel for ujson (setup.py): started Building wheel for ujson (setup.py): finished with status 'error' Running setup.py clean for ujson x86_64-linux-gnu-gcc -pthread -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fdebug-prefix-map=/build/python3.7-7jazGd/python3.7-3.7.11=. -fstack-protector-strong -Wformat -Werror=format-security -g -fdebug-prefix-map=/build/python3.7-7jazGd/python3.7-3.7.11=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I./python -I./lib -I/home/dataiku/dss_data/code-envs/python/plugin_timeseries-forecast_managed_5/include -I/usr/include/python3.7m -c ./python/ujson.c -o build/temp.linux-x86_64-3.7/./python/ujson.o -D_GNU_SOURCE In file included from ./python/ujson.c:39: ./python/py_defines.h:39:10: fatal error: Python.h: No such file or directory 39 | #include <Python.h> | ^~~~~~~~~~ compilation terminated. error: command 'x86_64-linux-gnu-gcc' failed with exit status 1 ---------------------------------------- ERROR: Failed building wheel for ujson
(i have attached the complete error log as attachment)
I tried your suggestion but it doesn't seem to work; any other suggestion?
thank you, I really appreciate the help!
Xavier
-
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,212 Dataiker
Hi,
The error "fatal error: Python.h: No such file or directory " suggests that python-devel is not installed.
Can you try re-running :
Ubuntu:
sudo apt-get install python-dev
sudo apt-get install python3-dev
For yum (CentOS, RHEL...):sudo yum install python-devel
sudo yum install python3-devel -
Hello @AlexT
they are already installed:
sudo apt-get install python-dev
Reading package lists... Done
Building dependency tree
Reading state information... Done
Note, selecting 'python-dev-is-python2' instead of 'python-dev'
python-dev-is-python2 is already the newest version (2.7.17-4).
0 upgraded, 0 newly installed, 0 to remove and 2 not upgraded.sudo apt-get install python3-dev
Reading package lists... Done
Building dependency tree
Reading state information... Done
python3-dev is already the newest version (3.8.2-0ubuntu2).
0 upgraded, 0 newly installed, 0 to remove and 2 not upgraded. -
Alexandru Dataiker, Dataiku DSS Core Designer, Dataiku DSS ML Practitioner, Dataiku DSS Adv Designer, Registered Posts: 1,212 Dataiker
Hi,
So the python3-dev version is 3.8. The logs show the code env is using Python 3.6.
Can you try installing python3.6-dev :
sudo apt-get install -y python3.6-dev
If that does not work you will need to add the following repository :
sudo add-apt-repository -y ppa:deadsnakes/ppa
If that does not resolve the issue can you please confirm :
1) exact OS version
2) How python 3.6 was installed
-
Hello @AlexT
actually even if sudo apt-get install python3-dev was already installed, i looked on the internet for answers regarding your specific comment, and i found a solution:
"sudo apt-get install python3.6-dev" did it!
i'm not sure why the "sudo apt-get install python3-dev" wasn't sufficient, but I was able to build the environment successfully
thanks a lot for helping!
Xavier
-
Most of the time these are dependency-issues. You need to install a package called python-dev. This package includes header files, a static library and development tools for building Python modules, extending the Python interpreter or embedding Python in applications. When encountering this error please note before the error it may say you are missing a package or header file — you should find those and install them and verify if it works
For Python 2.x use:
$ sudo apt-get install python-dev
If you using python3, try to replace python-dev with python3-dev
For a specific version of Python 3, replace x with the minor version in
$ sudo apt-get install python3.x-dev
