Setup & Configuration
- Hi, I'm trying to save pyspark model model.save("/opt/dataiku/design/managed_folders/PROJECT_TEST/9KeBcUKy/ML_SAVED") from notebook to managed folder but I'm getting the following error: Py4JJavaError…
Last answer by JordanBHi @Hardy75
,Assuming you have a locally managed folder, you can simply create an empty managed folder (i.e. the output of your recipe). Then, you just need the full path for the managed folder to pass that path to the keras model.save() function.
# this is a folder with a server filesystem connection
folder = dataiku.Folder('model_folder')
# this will return the full path of the managed folder
managed_folder_path = folder.get_path()
# now you can perform a model.save() function on the managed_folder_path
model.save(managed_folder_path + "/my_model.h5")Note that the keras model save() functions saves to a local filesystem, which is why this assumes that your managed folder is pointing to a local filesystem.Thanks!JordanLast answer by JordanBHi @Hardy75
,Assuming you have a locally managed folder, you can simply create an empty managed folder (i.e. the output of your recipe). Then, you just need the full path for the managed folder to pass that path to the keras model.save() function.
# this is a folder with a server filesystem connection
folder = dataiku.Folder('model_folder')
# this will return the full path of the managed folder
managed_folder_path = folder.get_path()
# now you can perform a model.save() function on the managed_folder_path
model.save(managed_folder_path + "/my_model.h5")Note that the keras model save() functions saves to a local filesystem, which is why this assumes that your managed folder is pointing to a local filesystem.Thanks!Jordan - Hi, I'm trying to setup "Containerized execution" using Docker. I've installed docker desktop then ran the following command: ./bin/dssadmin build-base-image --type container-exec When I test the dock…Last answer by
Last answer by matthieuThe docker container is trying to connect to the hostname slb-3qn42m3 which is locally significat to your setup and might not be known by your container running on docker for windows.
Make sure to configure the DKU_BACKEND_EXT_HOST as described in https://doc.dataiku.com/dss/latest/containers/troubleshooting.html The IP or URL configured there will be used by the container to reach back the DSS instance
- Hi all, Need help on how to connect to Snowflake via a python script in Dataiku. I have Snowflake connector already setup but that allows us to get data /tables into the flow. What I want is to connec…Last answer by
Last answer by HarizoRHi,
That would be the name of your Snowflake connection as it appears in Administration > Connections.
Best,
Harizo
- I am trying to hook up Visual Studio Code with the Enterprise version of Dataiku (a two-week free trial). I get the error: I added a Visual Studio code block, a streamlit block, and a code environment…Solution by
Solution by ClemenceBHi @Erlebacher
,
Having Elastic computation setup is a mandatory requirement for using Code Studios, as they run in Kubernetes clusters (read more in documentation).
If you're running Dataiku on your laptop and want to use VS Code to edit your code (code recipes, libraries, plugins), you should rather use the VS Code Extension.
I hope it answers your question, don't hesitate if you need more help.
Best,
Clémence - I tried to install DSS v11.0.2 on Ubuntu (20.04), but got an error: [+] Creating data directory: DATA_DIR [+] Saving installation log to /home/orange/Dataiku Installation Files/DATA_DIR/run/install.lo…Last answer byLast answer by JordanB