Can't create a code env for the Answers plugin (Automation node)

Edvin
Edvin Registered Posts: 9 ✭✭✭
in Plugins & Extending Dataiku

Hi,

I installed the Answers plugin (v2.2.1) on our self-managed Automation node without a code env, because the code env creation fails with this error:

Creation result
Errors were encountered

    ERROR
    ERR_CODEENV_CREATION_FAILED
    Environment creation failed
    null failed (exit code: 1)

           [01;31m[K^~~~~~~[m[K           [32m[K__m512d[m[K      In file included from [01m[Kinclude/simsimd/simsimd.h:111:0[m[K,                       from [01m[Kc/lib.c:54[m[K:      [01m[Kinclude/simsimd/sparse.h:[m[K At top level:      [01m[Kinclude/simsimd/sparse.h:277:9:[m[K [01;31m[Kerror: [m[Kattribute(target("avx512vbmi2")) is unknown       #pragma [01;31m[KGCC[m[K target("avx2", "avx512f", "avx512vl", "bmi2", "lzcnt", "popcnt", "avx512bw", "avx512vbmi2")               [01;31m[K^~~[m[K      [01m[Kinclude/simsimd/sparse.h:[m[K In function ‘[01m[K_simsimd_intersect_u16x32_ice[m[K’:      [01m[Kinclude/simsimd/sparse.h:294:19:[m[K [01;31m[Kerror: [m[Kincompatible types when initializing type ‘[01m[K__m512i {aka __vector(8) long long int}[m[K’ using type ‘[01m[Kint[m[K’           __m512i b01 = [01;31m[K_mm512_shrdi_epi32[m[K(b, b, 16);                         [01;31m[K^~~~~~~~~~~~~~~~~~[m[K      [01m[Kinclude/simsimd/sparse.h:295:19:[m[K [01;31m[Kerror: [m[Kincompatible types when initializing type ‘[01m[K__m512i {aka __vector(8) long long int}[m[K’ using type ‘[01m[Kint[m[K’           __m512i b11 = [01;31m[K_mm512_shrdi_epi32[m[K(b1, b1, 16);                         [01;31m[K^~~~~~~~~~~~~~~~~~[m[K      [01m[Kinclude/simsimd/sparse.h:296:19:[m[K [01;31m[Kerror: [m[Kincompatible types when initializing type ‘[01m[K__m512i {aka __vector(8) long long int}[m[K’ using type ‘[01m[Kint[m[K’           __m512i b21 = [01;31m[K_mm512_shrdi_epi32[m[K(b2, b2, 16);                         [01;31m[K^~~~~~~~~~~~~~~~~~[m[K      [01m[Kinclude/simsimd/sparse.h:297:19:[m[K [01;31m[Kerror: [m[Kincompatible types when initializing type ‘[01m[K__m512i {aka __vector(8) long long int}[m[K’ using type ‘[01m[Kint[m[K’           __m512i b31 = [01;31m[K_mm512_shrdi_epi32[m[K(b3, b3, 16);                         [01;31m[K^~~~~~~~~~~~~~~~~~[m[K      [01m[Kinclude/simsimd/sparse.h:[m[K At top level:      [01m[Kinclude/simsimd/sparse.h:529:9:[m[K [01;31m[Kerror: [m[Kattribute(target("avx512vbmi2")) is unknown       #pragma [01;31m[KGCC[m[K target("avx2", "avx512f", "avx512vl", "bmi2", "lzcnt", "popcnt", "avx512bw", "avx512vbmi2", "avx512bf16", \               [01;31m[K^~~[m[K      [01m[Kinclude/simsimd/sparse.h:529:9:[m[K [01;31m[Kerror: [m[Kattribute(target("avx512bf16")) is unknown      [01m[Kinclude/simsimd/sparse.h:529:9:[m[K [01;31m[Kerror: [m[Kattribute(target("avx512vnni")) is unknown      [01m[Kinclude/simsimd/sparse.h:529:9:[m[K [01;31m[Kerror: [m[Kattribute(target("avx512vp2intersect")) is unknown      [01m[Kinclude/simsimd/sparse.h:[m[K In function ‘[01m[Ksimsimd_spdot_weights_u16_turin[m[K’:      [01m[Kinclude/simsimd/sparse.h:739:27:[m[K [01;31m[Kerror: [m[Kincompatible types when assigning to type ‘[01m[K__m256i {aka __vector(4) long long int}[m[K’ from type ‘[01m[Kint[m[K’                   a_weights_vec [01;31m[K=[m[K _mm256_maskz_compress_epi16(a_matches_any_in_b, a_weights_vec);                                 [01;31m[K^[m[K      [01m[Kinclude/simsimd/sparse.h:741:27:[m[K [01;31m[Kerror: [m[Kincompatible types when assigning to type ‘[01m[K__m256i {aka __vector(4) long long int}[m[K’ from type ‘[01m[Kint[m[K’                   b_weights_vec [01;31m[K=[m[K _mm256_maskz_compress_epi16(b_matches_any_in_a, b_weights_vec);                                 [01;31m[K^[m[K      [01m[Kinclude/simsimd/sparse.h:742:70:[m[K [01;31m[Kerror: [m[K‘[01m[K__m256bh[m[K’ undeclared (first use in this function); did you mean ‘[01m[K__m256_u[m[K’?                   product_vec.ymmps = _mm256_dpbf16_ps(product_vec.ymmps, ([01;31m[K__m256bh[m[K)a_weights_vec, (__m256bh)b_weights_vec);                                                                            [01;31m[K^~~~~~~~[m[K                                                                            [32m[K__m256_u[m[K      [01m[Kinclude/simsimd/sparse.h:742:79:[m[K [01;31m[Kerror: [m[Kexpected ‘[01m[K)[m[K’ before ‘[01m[Ka_weights_vec[m[K’                   product_vec.ymmps = _mm256_dpbf16_ps(product_vec.ymmps, (__m256bh)[01;31m[Ka_weights_vec[m[K, (__m256bh)b_weights_vec);                                                                                     [01;31m[K^~~~~~~~~~~~~[m[K      [01m[Kinclude/simsimd/sparse.h:[m[K In function ‘[01m[Ksimsimd_spdot_counts_u16_turin[m[K’:      [01m[Kinclude/simsimd/sparse.h:824:27:[m[K [01;31m[Kerror: [m[Kincompatible types when assigning to type ‘[01m[K__m256i {aka __vector(4) long long int}[m[K’ from type ‘[01m[Kint[m[K’                   a_weights_vec [01;31m[K=[m[K _mm256_maskz_compress_epi16(a_matches_any_in_b, a_weights_vec);                                 [01;31m[K^[m[K      [01m[Kinclude/simsimd/sparse.h:826:27:[m[K [01;31m[Kerror: [m[Kincompatible types when assigning to type ‘[01m[K__m256i {aka __vector(4) long long int}[m[K’ from type ‘[01m[Kint[m[K’                   b_weights_vec [01;31m[K=[m[K _mm256_maskz_compress_epi16(b_matches_any_in_a, b_weights_vec);                                 [01;31m[K^[m[K      [01m[Kinclude/simsimd/sparse.h:827:29:[m[K [01;31m[Kerror: [m[Kincompatible types when assigning to type ‘[01m[K__m256i {aka __vector(4) long long int}[m[K’ from type ‘[01m[Kint[m[K’                   product_vec.ymm [01;31m[K=[m[K _mm256_dpwssds_epi32(product_vec.ymm, a_weights_vec, b_weights_vec);                                   [01;31m[K^[m[K      In file included from [01m[Kinclude/simsimd/curved.h:41:0[m[K,                       from [01m[Kinclude/simsimd/simsimd.h:106[m[K,                       from [01m[Kc/lib.c:54[m[K:      [01m[Kinclude/simsimd/spatial.h:[m[K In function ‘[01m[K_simsimd_substract_bf16x32_genoa[m[K’:Using cached zipp-3.21.0-py3-none-any.whl (9.6 kB)Using cached filelock-3.18.0-py3-none-any.whl (16 kB)Using cached pycparser-2.22-py3-none-any.whl (117 kB)Using cached wsproto-1.2.0-py3-none-any.whl (24 kB)Building wheels for collected packages: pypika, simsimd  Building wheel for pypika (pyproject.toml): started  Building wheel for pypika (pyproject.toml): finished with status 'done'  Created wheel for pypika: filename=pypika-0.48.9-py2.py3-none-any.whl size=53801 sha256=7b661bec4f328b5cf647fcf139a0c72acd94d63ebe2b2d4e91706193226a080a  Stored in directory: /home/dataiku/.cache/pip/wheels/a3/01/bd/4c40ceb9d5354160cb186dcc153360f4ab7eb23e2b24daf96d  Building wheel for simsimd (pyproject.toml): started  Building wheel for simsimd (pyproject.toml): finished with status 'error'Successfully built pypikaFailed to build simsimd      [01m[Kinclude/simsimd/spatial.h:1676:26:[m[K [01;36m[Knote: [m[KThe ABI for passing parameters with 64-byte alignment has changed in GCC 4.6       SIMSIMD_INTERNAL __m512i [01;36m[K_simsimd_substract_bf16x32_genoa[m[K(__m512i a_i16, __m512i b_i16) {                                [01;36m[K^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~[m[K      error: command '/usr/bin/gcc' failed with exit code 1      [end of output]    note: This error originates from a subprocess, and is likely not a problem with pip.  ERROR: Failed building wheel for simsimd[notice] A new release of pip is available: 24.2 -> 25.1.1[notice] To update, run: /data/dataiku/automation/acode-envs/python/plugin_document-question-answering_managed_2/env/bin/python -m pip install --upgrade pipERROR: ERROR: Failed to build installable wheels for some pyproject.toml based projects (simsimd)

I tried using both Python 3.9 and Python 3.11. I picked "Managed by DSS (recommended)" every time. I didn't select "Use Conda".
Before my last attempt at creating a code env, I ran "yum update" on the node.

We're using Dataiku v13.4.2.

Br,
Edvin

Operating system used: Amazon Linux 2

Tagged:
· Share on FacebookShare on Twitter

Answers

  • Yasmine_T
    Yasmine_T Registered Posts: 39 ✭✭✭

    Hi,

    I hope that you are doing well.

    This issue would require deeper investigation and will be best handled through a support ticket using your company email. Could you please open a support ticket and link this community post so that our team can further investigate and provide you with the next steps to troubleshoot your issue.

    Best,

    Yasmine

    · Share on FacebookShare on Twitter
  • Edvin
    Edvin Registered Posts: 9 ✭✭✭

    Hi,

    We opened a support ticket. Thanks.

    Br,

    Edvin

    · Share on FacebookShare on Twitter
Bookmark this topic

Categories

Setup Info
    Tags
      Help me…