Reactions
-
Re: Connection to locally hosted LLM on Apple Silicon
Hi @tgb417 and @m_arik , Wow, the TitanML plugin that tgb417 linked to above seems like just the ticket for running LLMs locally with Dataiku. Thanks for the heads-up. For my case especially (and any…1 · -
Connection to locally hosted LLM on Apple Silicon
Is there any way to setup a connection that connects to a locally running LLM? On Apple Silicon it is possible to run huggingface models locally with some different open source solutions, which make …1 · -
Reusing few-shot classification prompts in prompt studio?
Hi Dataiku'ers, Playing around with the few-shot classification prompts in prompt studio using Open AI GPT, it looks like the entire prompt is sent to the LLM for each row of data to be classified. W…1 ·
