In Design Node LLM connection details
We have several projects in Design Node. How many LLMs are used across all of the projects? How will we gather all the information so that we can recommend the best LLM to each project owner or solicit suggestions for improvement?
Answers
-
Hi,
I hope that you are doing well:)
- How many LLMs are used across all of the projects? How will we gather all the information
There is no easy way to list usage at model level, there are two approaches that could be taken here
a. You could do so by looking at your connection definition/usage. This would be done through node/project exploration (looking at LLM Connections set in your Design node, and going to individual projects to look at different usage). This doesn't seem like the best approach as it seems that you are looking at a more general overview/usage tracking.
b. Taking a look at your Audit logs. Each LLM query generates an audit event with the project + model id. The Audit log can be enabled as an extension for your instance in your launchpad.
2.
I am not sure if you are asking for suggestion from our end or if you are looking into making your own recommendation based on user usage data. On our end besides the deprecation warnings we display in connection pages there is no such thing in DSS.
Let me know if i have covered everything here or if you have any further questions.
Best,
Yasmine