Per-user credentials in LLM connections

Jennifer
Registered Posts: 4 ✭✭
This request is to add support for per-user credentials in LLM connections. We use OpenAI and set up API keys per project so that we can track spend and budgets at the project level. Currently we have to set up a separate OpenAI connection for each project but ideally we would be able to pass the API key in either through variable expansion or per-user credentials.