Here is a list of 3 pieces of free software that we can use to run LLMs locally on our laptops-desktops.
1. GPT4All (https://gpt4all.io/index.html) 🤖
Available on: Windows, MacOS, Ubuntu.
Key Features:
- Models: it supports a range of models, such as Llama and Mistral (here is a list of some of the models available: https://raw.githubusercontent.com/nomic-ai/gpt4all/main/gpt4all-chat/metadata/models3.json)
- Community Support: a very active community of users and developers.
- GPT4All Open Source datalake: this is quite a cool tool: https://gpt4all.io/index.html
2. LM Studio (https://lmstudio.ai/) 🏠
Available on: Windows, MacOS, Linux (beta).
Key Features:
- Models: Llama 3, Phi 3, Falcon, Mistral, StarCoder, Gemma, etc.
- Model Customisation: it offers settings for optimising models.
- Comprehensive Documentation: Detailed guides and tutorials to help both beginners and advanced users.
3. Ollama (https://ollama.com/) 🦙
Available on: Windows (preview), MacOS, Linux.
Key Features:
- Models: more than 80 models available for download and installation.
- Blog: their blog includes AI-related news and updates.
- Model customisation: here is a nice step-by-step guide on how to customise models with Ollama (https://medium.com/@sumudithalanz/unlocking-the-power-of-large-language-models-a-guide-to-customization-with-ollama-6c0da1e756d9)
That’s all! I will keep adding new pieces of software to the list as soon as I have tried them. 😄
Luis Damián Moreno García (PhD, FHEA) 