changing python code env

sambili · August 15

I am unable to change my python code env, I was creating a plugin ,I am unable to test it because every time I run it Dss uses default environment even if I explicitly select my environment with has Biopython installed , any help?

[2024/08/16-01:57:09.508] [ActivityExecutor-39] [INFO] [dku] running compute_dnat-translated_NP - ----------------------------------------

[2024/08/16-01:57:09.508] [ActivityExecutor-39] [INFO] [dku] running compute_dnat-translated_NP - DSS startup: jek version:13.1.0

[2024/08/16-01:57:09.508] [ActivityExecutor-39] [INFO] [dku] running compute_dnat-translated_NP - DSS home: C:\Users\synnotus\AppData\Local\Dataiku\DataScienceStudio\dss_home

[2024/08/16-01:57:09.508] [ActivityExecutor-39] [INFO] [dku] running compute_dnat-translated_NP - OS: Windows 10 10.0 amd64 - Java: Eclipse Adoptium 11.0.22

[2024/08/16-01:57:09.486] [ActivityExecutor-39] [INFO] [dku.flow.jobrunner] running compute_dnat-translated_NP - Allocated a slot for this activity!

[2024/08/16-01:57:09.522] [ActivityExecutor-39] [DEBUG] [dku.flow.jobrunner] running compute_dnat-translated_NP - Calling runActivity

[2024/08/16-01:57:09.525] [ActivityExecutor-39] [INFO] [dku.flow.jobrunner] running compute_dnat-translated_NP - Run activity

[2024/08/16-01:57:09.555] [ActivityExecutor-39] [INFO] [dku.flow.activity] running compute_dnat-translated_NP - Executing default pre-activity lifecycle hook

[2024/08/16-01:57:09.577] [ActivityExecutor-39] [INFO] [dku.flow.activity] running compute_dnat-translated_NP - Checking if sources are ready

[2024/08/16-01:57:09.589] [ActivityExecutor-39] [INFO] [dku.flow.activity] running compute_dnat-translated_NP - Will check readiness of DNAAT.dnaat p=NP

[2024/08/16-01:57:09.675] [ActivityExecutor-39] [INFO] [dku.datasets.file] running compute_dnat-translated_NP - Building Filesystem handler config: {"path":"C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\uploads\\DNAAT\\datasets\\dnaat","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]},"variablesExpansionLoopConfig":{"enabled":false,"mode":"CREATE_VARIABLE_FOR_EACH_COLUMN","replacements":[]}}

[2024/08/16-01:57:09.761] [ActivityExecutor-39] [INFO] [dku.datasets.ftplike] running compute_dnat-translated_NP - Variable-expanded selection rules: {"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]}

[2024/08/16-01:57:09.762] [ActivityExecutor-39] [DEBUG] [dku.datasets.fsbased] running compute_dnat-translated_NP - getReadiness: will enumerate partition <partition:NP>

[2024/08/16-01:57:09.769] [ActivityExecutor-39] [INFO] [dku.datasets.ftplike] running compute_dnat-translated_NP - Enumerating Filesystem dataset prefix=

[2024/08/16-01:57:09.770] [ActivityExecutor-39] [DEBUG] [dku.datasets.fsbased] running compute_dnat-translated_NP - Building FS provider for dataset handler: DNAAT.dnaat

[2024/08/16-01:57:09.778] [ActivityExecutor-39] [DEBUG] [dku.datasets.fsbased] running compute_dnat-translated_NP - FS Provider built

[2024/08/16-01:57:09.786] [ActivityExecutor-39] [DEBUG] [dku.fs.local] running compute_dnat-translated_NP - Enumerating local filesystem prefix=/

[2024/08/16-01:57:09.791] [ActivityExecutor-39] [DEBUG] [dku.fs.local] running compute_dnat-translated_NP - Enumeration done nb_paths=1 size=544

[2024/08/16-01:57:09.795] [ActivityExecutor-39] [DEBUG] [dku.datasets.fsbased] running compute_dnat-translated_NP - getReadiness: enumerated partition, found 1 paths, computing hash

[2024/08/16-01:57:09.802] [ActivityExecutor-39] [INFO] [dku.flow.activity] running compute_dnat-translated_NP - Checked source readiness DNAAT.dnaat -> true

[2024/08/16-01:57:09.813] [ActivityExecutor-39] [DEBUG] [dku.flow.activity] running compute_dnat-translated_NP - Computing hashes to propagate BEFORE activity

[2024/08/16-01:57:09.820] [ActivityExecutor-39] [DEBUG] [dku.flow.activity] running compute_dnat-translated_NP - Recorded 1 hashes before activity run

[2024/08/16-01:57:09.821] [ActivityExecutor-39] [DEBUG] [dku.flow.activity] running compute_dnat-translated_NP - Building recipe runner of type

[2024/08/16-01:57:09.844] [ActivityExecutor-39] [DEBUG] [dku.flow.activity] running compute_dnat-translated_NP - Recipe runner built, will use 1 thread(s)

[2024/08/16-01:57:09.845] [ActivityExecutor-39] [DEBUG] [dku.flow.activity] running compute_dnat-translated_NP - Preparing execution thread: com.dataiku.dip.recipes.customcode.CustomPythonRecipeRunner@16dabc9f

[2024/08/16-01:57:09.852] [ActivityExecutor-39] [DEBUG] [dku.flow.activity] running compute_dnat-translated_NP - Starting execution thread: Thread[Thread-20,5,main]

[2024/08/16-01:57:09.854] [ActivityExecutor-39] [DEBUG] [dku.flow.activity] running compute_dnat-translated_NP - Execution threads started, waiting for activity end

[2024/08/16-01:57:09.872] [FRT-44-FlowRunnable] [INFO] [dku.flow.activity] - Run thread for activity compute_dnat-translated_NP starting

[2024/08/16-01:57:09.901] [FRT-44-FlowRunnable] [INFO] [dku.flow.custompython] - Dumping Python script to C:\Users\synnotus\AppData\Local\Dataiku\DataScienceStudio\dss_home\jobs\DNAAT\Build_dnat_translated__NP__2024-08-15T22-57-08.137\compute_dnat-translated_NP\custom-python-recipe\pyoutEOIJRzcqLT9b\script.py

[2024/08/16-01:57:09.939] [FRT-44-FlowRunnable] [INFO] [com.dataiku.dip.analysis.ml.distributed.workers] - New worker pool created: pool-zydi8uij7n83inmh

[2024/08/16-01:57:09.941] [FRT-44-FlowRunnable] [INFO] [dku.flow.abstract.python] - Dumping Python script to C:\Users\synnotus\AppData\Local\Dataiku\DataScienceStudio\dss_home\jobs\DNAAT\Build_dnat_translated__NP__2024-08-15T22-57-08.137\compute_dnat-translated_NP\custom-python-recipe\pyoutEOIJRzcqLT9b\script.py

[2024/08/16-01:57:09.971] [FRT-44-FlowRunnable] [INFO] [dku.datasets.file] - Building Filesystem handler config: {"connection":"filesystem_managed","path":"DNAAT/dnat-translated","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]},"variablesExpansionLoopConfig":{"enabled":false,"mode":"CREATE_VARIABLE_FOR_EACH_COLUMN","replacements":[]}}

[2024/08/16-01:57:09.973] [FRT-44-FlowRunnable] [DEBUG] [dku.datasets.fsbased] - Building FS provider for dataset handler: DNAAT.dnat-translated

[2024/08/16-01:57:09.979] [FRT-44-FlowRunnable] [DEBUG] [dku.datasets.fsbased] - FS Provider built

[2024/08/16-01:57:10.002] [FRT-44-FlowRunnable] [INFO] [dku.datasets.file] - Building Filesystem handler config: {"path":"C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\uploads\\DNAAT\\datasets\\dnaat","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]},"variablesExpansionLoopConfig":{"enabled":false,"mode":"CREATE_VARIABLE_FOR_EACH_COLUMN","replacements":[]}}

[2024/08/16-01:57:10.004] [FRT-44-FlowRunnable] [DEBUG] [dku.datasets.fsbased] - Building FS provider for dataset handler: DNAAT.dnaat

[2024/08/16-01:57:10.005] [FRT-44-FlowRunnable] [DEBUG] [dku.datasets.fsbased] - FS Provider built

[2024/08/16-01:57:10.013] [FRT-44-FlowRunnable] [INFO] [dku.datasets.file] - Building Filesystem handler config: {"path":"C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\uploads\\DNAAT\\datasets\\dnaat","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]},"variablesExpansionLoopConfig":{"enabled":false,"mode":"CREATE_VARIABLE_FOR_EACH_COLUMN","replacements":[]}}

[2024/08/16-01:57:10.018] [FRT-44-FlowRunnable] [DEBUG] [dku.datasets.fsbased] - Building FS provider for dataset handler: DNAAT.dnaat

[2024/08/16-01:57:10.020] [FRT-44-FlowRunnable] [DEBUG] [dku.datasets.fsbased] - FS Provider built

[2024/08/16-01:57:10.056] [FRT-44-FlowRunnable] [INFO] [dku.code.projectLibs] - EXTERNAL LIBS FROM DNAAT is {"gitReferences":{},"pythonPath":["python"],"rsrcPath":["R"],"importLibrariesFromProjects":[]}

[2024/08/16-01:57:10.069] [FRT-44-FlowRunnable] [DEBUG] [dku.code.projectLibs] - Impersonation or zipped config are enabled, copying project DNAAT lib chunk /projects/DNAAT/lib/python to C:\Users\synnotus\AppData\Local\Dataiku\DataScienceStudio\dss_home\jobs\DNAAT\Build_dnat_translated__NP__2024-08-15T22-57-08.137\compute_dnat-translated_NP\custom-python-recipe\pyoutEOIJRzcqLT9b\project-python-libs\DNAAT\python

[2024/08/16-01:57:10.089] [FRT-44-FlowRunnable] [INFO] [dku.code.projectLibs] - chunkFolder is /projects/DNAAT/lib/R

[2024/08/16-01:57:10.090] [FRT-44-FlowRunnable] [DEBUG] [dku.code.projectLibs] - Impersonation or zipped config are enabled, copying project lib chunk /projects/DNAAT/lib/R to C:\Users\synnotus\AppData\Local\Dataiku\DataScienceStudio\dss_home\jobs\DNAAT\Build_dnat_translated__NP__2024-08-15T22-57-08.137\compute_dnat-translated_NP\custom-python-recipe\pyoutEOIJRzcqLT9b\project-r-src\DNAAT\R

[2024/08/16-01:57:10.104] [FRT-44-FlowRunnable] [INFO] [dip.plugin.presets] - Checking project-level settings for overriden presets and additional presets

[2024/08/16-01:57:10.144] [FRT-44-FlowRunnable] [INFO] [dku.recipes.code.base] - Writing dku-exec-env for local execution in C:\Users\synnotus\AppData\Local\Dataiku\DataScienceStudio\dss_home\jobs\DNAAT\Build_dnat_translated__NP__2024-08-15T22-57-08.137\compute_dnat-translated_NP\custom-python-recipe\pyoutEOIJRzcqLT9b\remote-run-env-def.json

[2024/08/16-01:57:10.170] [FRT-44-FlowRunnable] [INFO] [dku.code.envs.resolution] - Executing Python activity in builtin env

[2024/08/16-01:57:10.186] [FRT-44-FlowRunnable] [INFO] [dku.flow.abstract.python] - Execute activity command: ["C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\pyenv\\Scripts\\python.exe","-u","C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\jobs\\DNAAT\\Build_dnat_translated__NP__2024-08-15T22-57-08.137\\compute_dnat-translated_NP\\custom-python-recipe\\pyoutEOIJRzcqLT9b\\python-exec-wrapper.py","C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\jobs\\DNAAT\\Build_dnat_translated__NP__2024-08-15T22-57-08.137\\compute_dnat-translated_NP\\custom-python-recipe\\pyoutEOIJRzcqLT9b\\script.py"]

[2024/08/16-01:57:10.189] [FRT-44-FlowRunnable] [INFO] [dku.flow.abstract.python] - Attached worker pool to com.dataiku.dip.recipes.customcode.CustomPythonRecipeRunner recipe runner: pool-zydi8uij7n83inmh

[2024/08/16-01:57:10.196] [FRT-44-FlowRunnable] [INFO] [dku.process] - Starting process (regular)

[2024/08/16-01:57:10.236] [FRT-44-FlowRunnable] [INFO] [dku.process] - Process started with pid=9192

[2024/08/16-01:57:10.269] [FRT-44-FlowRunnable] [DEBUG] [dku.resourceusage] - Reporting start of CRU:{"context":{"type":"JOB_ACTIVITY","authIdentifier":"admin","projectKey":"DNAAT","jobId":"Build_dnat_translated__NP__2024-08-15T22-57-08.137","activityId":"compute_dnat-translated_NP","activityType":"recipe","recipeType":"CustomCode_translator","recipeName":"compute_dnat-translated"},"type":"LOCAL_PROCESS","id":"tedH1tvax3bmafLx","startTime":1723762630256,"localProcess":{"cpuCurrent":0.0,"cpuAverageOverPast60Seconds":0.0}}

[2024/08/16-01:57:10.368] [process-resource-monitor-9192-49] [DEBUG] [dku.resource]  - Process stats for pid 9192: {"pid":9192,"commandName":"C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\pyenv\\Scripts\\python.exe","cpuCurrent":0.0,"cpuAverageOverPast60Seconds":0.0,"vmRSSTotalMBS":0}

[2024/08/16-01:57:10.576] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:10,576 INFO --------------------

[2024/08/16-01:57:10.577] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:10,576 INFO Dataiku Python entrypoint starting up

[2024/08/16-01:57:10.578] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:10,576 INFO executable = C:\Users\synnotus\AppData\Local\Dataiku\DataScienceStudio\dss_home\pyenv\Scripts\python.exe

[2024/08/16-01:57:10.581] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:10,576 INFO argv = ['C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\jobs\\DNAAT\\Build_dnat_translated__NP__2024-08-15T22-57-08.137\\compute_dnat-translated_NP\\custom-python-recipe\\pyoutEOIJRzcqLT9b\\python-exec-wrapper.py', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\jobs\\DNAAT\\Build_dnat_translated__NP__2024-08-15T22-57-08.137\\compute_dnat-translated_NP\\custom-python-recipe\\pyoutEOIJRzcqLT9b\\script.py']

[2024/08/16-01:57:10.583] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:10,576 INFO --------------------

[2024/08/16-01:57:10.584] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:10,576 INFO Looking for RemoteRunEnvDef in .\remote-run-env-def.json

[2024/08/16-01:57:10.585] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:10,577 INFO Found RemoteRunEnvDef environment: .\remote-run-env-def.json 

[2024/08/16-01:57:10.601] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:10,600 INFO Running a DSS Python recipe locally, uinsetting env

[2024/08/16-01:57:10.604] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:10,604 INFO Setup complete, ready to execute Python code

[2024/08/16-01:57:10.606] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:10,604 INFO Sys path: ['C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\jobs\\DNAAT\\Build_dnat_translated__NP__2024-08-15T22-57-08.137\\compute_dnat-translated_NP\\custom-python-recipe\\pyoutEOIJRzcqLT9b', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\lib\\python', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\kits\\dataiku-dss-13.1.0-win\\python', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\Python\\python-3.7.13\\python37.zip', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\Python\\python-3.7.13\\DLLs', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\Python\\python-3.7.13\\lib', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\Python\\python-3.7.13', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\pyenv', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\pyenv\\lib\\site-packages', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\kits\\dataiku-dss-13.1.0-win\\pythonwin.packages', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\kits\\dataiku-dss-13.1.0-win\\pythonwin.packages\\win32', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\kits\\dataiku-dss-13.1.0-win\\pythonwin.packages\\win32\\lib', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\kits\\dataiku-dss-13.1.0-win\\pythonwin.packages\\Pythonwin', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\jobs\\DNAAT\\Build_dnat_translated__NP__2024-08-15T22-57-08.137\\compute_dnat-translated_NP\\custom-python-recipe\\pyoutEOIJRzcqLT9b\\project-python-libs\\DNAAT\\python', 'C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\plugins\\dev\\biopython\\python-lib']

[2024/08/16-01:57:10.607] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:10,604 INFO Script file: C:\Users\synnotus\AppData\Local\Dataiku\DataScienceStudio\dss_home\jobs\DNAAT\Build_dnat_translated__NP__2024-08-15T22-57-08.137\compute_dnat-translated_NP\custom-python-recipe\pyoutEOIJRzcqLT9b\script.py

[2024/08/16-01:57:14.892] [null-err-47] [INFO] [dku.utils]  - *************** Recipe code failed **************

[2024/08/16-01:57:14.894] [null-err-47] [INFO] [dku.utils]  - Begin Python stack

[2024/08/16-01:57:14.896] [null-err-47] [INFO] [dku.utils]  - Traceback (most recent call last):

[2024/08/16-01:57:14.898] [null-err-47] [INFO] [dku.utils]  -   File "<string>", line 10, in <module>

[2024/08/16-01:57:14.899] [null-err-47] [INFO] [dku.utils]  - ModuleNotFoundError: No module named 'Bio'

[2024/08/16-01:57:14.900] [null-err-47] [INFO] [dku.utils]  - During handling of the above exception, another exception occurred:

[2024/08/16-01:57:14.901] [null-err-47] [INFO] [dku.utils]  - Traceback (most recent call last):

[2024/08/16-01:57:14.902] [null-err-47] [INFO] [dku.utils]  -   File "C:\Users\synnotus\AppData\Local\Dataiku\DataScienceStudio\dss_home\jobs\DNAAT\Build_dnat_translated__NP__2024-08-15T22-57-08.137\compute_dnat-translated_NP\custom-python-recipe\pyoutEOIJRzcqLT9b\python-exec-wrapper.py", line 204, in <module>

[2024/08/16-01:57:14.903] [null-err-47] [INFO] [dku.utils]  -     exec(f.read())

[2024/08/16-01:57:14.904] [null-err-47] [INFO] [dku.utils]  -   File "<string>", line 13, in <module>

[2024/08/16-01:57:14.905] [null-err-47] [INFO] [dku.utils]  - ValueError: Biopython is not installed in the current environment: Unknown Environment. Please install it using `pip install biopython`.

[2024/08/16-01:57:14.906] [null-err-47] [INFO] [dku.utils]  - End Python stack

[2024/08/16-01:57:14.907] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:14,904 INFO Check if spark is available

[2024/08/16-01:57:14.908] [null-err-47] [INFO] [dku.utils]  - 2024-08-16 01:57:14,906 INFO Not stopping a spark context: No module named 'pyspark'

[2024/08/16-01:57:15.373] [FRT-44-FlowRunnable] [DEBUG] [dku.resourceusage] - Reporting completion of CRU:{"context":{"type":"JOB_ACTIVITY","authIdentifier":"admin","projectKey":"DNAAT","jobId":"Build_dnat_translated__NP__2024-08-15T22-57-08.137","activityId":"compute_dnat-translated_NP","activityType":"recipe","recipeType":"CustomCode_translator","recipeName":"compute_dnat-translated"},"type":"LOCAL_PROCESS","id":"tedH1tvax3bmafLx","startTime":1723762630256,"localProcess":{"pid":9192,"commandName":"C:\\Users\\synnotus\\AppData\\Local\\Dataiku\\DataScienceStudio\\dss_home\\pyenv\\Scripts\\python.exe","cpuCurrent":0.0,"cpuAverageOverPast60Seconds":0.0,"vmRSSTotalMBS":0}}

[2024/08/16-01:57:15.375] [FRT-44-FlowRunnable] [INFO] [dip.exec.resultHandler] - Error file found, trying to throw it: C:\Users\synnotus\AppData\Local\Dataiku\DataScienceStudio\dss_home\jobs\DNAAT\Build_dnat_translated__NP__2024-08-15T22-57-08.137\compute_dnat-translated_NP\custom-python-recipe\pyoutEOIJRzcqLT9b\error.json

[2024/08/16-01:57:15.383] [FRT-44-FlowRunnable] [INFO] [dip.exec.resultHandler] - Raw error is{"errorType":"\u003cclass \u0027ValueError\u0027\u003e","message":"Biopython is not installed in the current environment: Unknown Environment. Please install it using `pip install biopython`.","detailedMessage":"At line 13: \u003cclass \u0027ValueError\u0027\u003e: Biopython is not installed in the current environment: Unknown Environment. Please install it using `pip install biopython`.","stackTrace":[]}

[2024/08/16-01:57:15.391] [FRT-44-FlowRunnable] [INFO] [dip.exec.resultHandler] - After enrichment of error file, error is: {"errorType":"\u003cclass \u0027ValueError\u0027\u003e","message":"Error in Python process: Biopython is not installed in the current environment: Unknown Environment. Please install it using `pip install biopython`.","detailedMessage":"Error in Python process: At line 13: \u003cclass \u0027ValueError\u0027\u003e: Biopython is not installed in the current environment: Unknown Environment. Please install it using `pip install biopython`.","stackTrace":[]}

[2024/08/16-01:57:15.399] [FRT-44-FlowRunnable] [INFO] [com.dataiku.dip.analysis.ml.distributed.workers] - Closing worker pool pool-zydi8uij7n83inmh

[2024/08/16-01:57:15.401] [FRT-44-FlowRunnable] [INFO] [com.dataiku.dip.analysis.ml.distributed.workers] - Unregistered worker pool: pool-zydi8uij7n83inmh

[2024/08/16-01:57:15.453] [FRT-44-FlowRunnable] [INFO] [dku.flow.activity] - Run thread failed for activity compute_dnat-translated_NP

com.dataiku.common.server.APIError$SerializedErrorException: Error in Python process: At line 13: <class 'ValueError'>: Biopython is not installed in the current environment: Unknown Environment. Please install it using `pip install biopython`.

	at com.dataiku.dip.dataflow.exec.JobExecutionResultHandler.throwFromErrorFileIfPossible(JobExecutionResultHandler.java:108)

	at com.dataiku.dip.dataflow.exec.JobExecutionResultHandler.throwFromErrorFileOrLogs(JobExecutionResultHandler.java:39)

	at com.dataiku.dip.dataflow.exec.JobExecutionResultHandler.throwFromErrorFileOrLogs(JobExecutionResultHandler.java:34)

	at com.dataiku.dip.dataflow.exec.JobExecutionResultHandler.handleExecutionResult(JobExecutionResultHandler.java:26)

	at com.dataiku.dip.dataflow.exec.AbstractCodeBasedActivityRunner.execute(AbstractCodeBasedActivityRunner.java:70)

	at com.dataiku.dip.dataflow.exec.AbstractPythonRecipeRunner.executeScript(AbstractPythonRecipeRunner.java:70)

	at com.dataiku.dip.recipes.customcode.CustomPythonRecipeRunner.run(CustomPythonRecipeRunner.java:79)

	at com.dataiku.dip.dataflow.jobrunner.ActivityRunner$FlowRunnableThread.run(ActivityRunner.java:422)

[2024/08/16-01:57:15.481] [ActivityExecutor-39] [INFO] [dku.flow.activity] running compute_dnat-translated_NP - activity is finished

[2024/08/16-01:57:15.482] [ActivityExecutor-39] [ERROR] [dku.flow.activity] running compute_dnat-translated_NP - Activity failed

com.dataiku.common.server.APIError$SerializedErrorException: Error in Python process: At line 13: <class 'ValueError'>: Biopython is not installed in the current environment: Unknown Environment. Please install it using `pip install biopython`.

	at com.dataiku.dip.dataflow.exec.JobExecutionResultHandler.throwFromErrorFileIfPossible(JobExecutionResultHandler.java:108)

	at com.dataiku.dip.dataflow.exec.JobExecutionResultHandler.throwFromErrorFileOrLogs(JobExecutionResultHandler.java:39)

	at com.dataiku.dip.dataflow.exec.JobExecutionResultHandler.throwFromErrorFileOrLogs(JobExecutionResultHandler.java:34)

	at com.dataiku.dip.dataflow.exec.JobExecutionResultHandler.handleExecutionResult(JobExecutionResultHandler.java:26)

	at com.dataiku.dip.dataflow.exec.AbstractCodeBasedActivityRunner.execute(AbstractCodeBasedActivityRunner.java:70)

	at com.dataiku.dip.dataflow.exec.AbstractPythonRecipeRunner.executeScript(AbstractPythonRecipeRunner.java:70)

	at com.dataiku.dip.recipes.customcode.CustomPythonRecipeRunner.run(CustomPythonRecipeRunner.java:79)

	at com.dataiku.dip.dataflow.jobrunner.ActivityRunner$FlowRunnableThread.run(ActivityRunner.java:422)

[2024/08/16-01:57:15.483] [ActivityExecutor-39] [INFO] [dku.flow.activity] running compute_dnat-translated_NP - Executing default post-activity lifecycle hook

[2024/08/16-01:57:15.500] [ActivityExecutor-39] [INFO] [dku.flow.activity] running compute_dnat-translated_NP - Done post-activity tasks

[2024/08/16-01:57:15.501] [ActivityExecutor-39] [INFO] [dku.flow.activity] running compute_dnat-translated_NP - done handling times

[2024/08/16-01:57:15.502] [ActivityExecutor-39] [DEBUG] [dku.flow.jobrunner] running compute_dnat-translated_NP - runActivity terminated, success=false

[2024/08/16-01:57:15.503] [ActivityExecutor-39] [DEBUG] [dku.flow.jobrunner] running compute_dnat-translated_NP - Signaling end of activity to backend

[2024/08/16-01:57:15.643] [ActivityExecutor-39] [DEBUG] [dku.flow.jobrunner] running compute_dnat-translated_NP - Done signaling end of activity to backend

Operating system used: windows 10

Grixis · August 16

Hey @sambili

Do you have defined an dedicated code environment of your plugin ? This is good practice to avoid having to set incompatible env code. By the way, that default code env isn't fit for managing custom plugin at all.

Could you inside your code env settings and check in "update log" if that this lib has been installed correctly. Also I don't know this librairy specifically, isn't there a change in the name depending of python version env ?

Let me know

changing python code env

Answers

Categories

Setup Info

Tags