Given that LLMs can be installed on Apple Silicon Based Computers that can have significant GPU access able RAM. It is possible to run LLMs and Diffusion Models. One can use a variety of approaches. For example using instructions like this:
https://github.com/domschl/HuggingFaceGuidedTourForMac
And other methods.
Has anyone worked out how to connect these models to DSS as part of the LLM mesh?
Operating system used: Mac OS
--Tom
