Ollama on DSS

Wilfred
Partner, Registered Posts: 2 Partner
Pardon my ignorance on the subject but is there a way to connect to a model like llama2 or mistral running on Ollama locally or another k8s cluster to DSS
Operating system used: Suse 15
Answers
-
Turribeach Dataiku DSS Core Designer, Neuron, Dataiku DSS Adv Designer, Registered, Neuron 2023 Posts: 2,248 Neuron
Hi, yes, you can use local LLM models. For this you need to use Dataiku's LLM Mesh:
https://www.dataiku.com/product/key-capabilities/llm-mesh/
https://doc.dataiku.com/dss/latest/generative-ai/index.html
k8s is also supported: