LLM Service Plugin?

importthepandas
LLM Service Plugin?

This might end up as a product idea if it is not already, but is there currently a way e.g. via plugins to incorporate an internal foundation model with its associated API endpoints? Essentially, we are wanting to create a new LLM connection.


Operating system used: Ubuntu 20

0 Replies