Ollama on DSS

Wilfred

Pardon my ignorance on the subject but is there a way to connect to a model like llama2 or mistral running on Ollama locally or another k8s cluster to DSS

Operating system used: Suse 15

Turribeach

Hi, yes, you can use local LLM models. For this you need to use Dataiku's LLM Mesh:

https://www.dataiku.com/product/key-capabilities/llm-mesh/

https://doc.dataiku.com/dss/latest/generative-ai/index.html

k8s is also supported:

https://doc.dataiku.com/dss/latest/containers/index.html

rrelais4x100à2

For those looking to connect Dataiku on a local Linux system to Ollama, I've actually built a plugin that might be helpful. It allows you to directly process dataframes using locally running Ollama models. You can find the GitHub repository here: https://github.com/Relais4x100a2/dataiku-ollama-plugin It could offer a more direct way to integrate with your local setup.