LM Studio

LM Studio is a local large language model (LLM) application software that allows users to download, run, and experiment with open-source large language models on their local computers. It provides a user-friendly graphical interface, making the installation and use of these models simple and quick. LM Studio supports a variety of open-source models, such as Llama, MPT, Gemma, etc., and can be used in conjunction with tools such as open-webui.