Awesome Local LLM

This repository curates platforms, tools, practices, and resources for running language models locally.

github.com/rafska/awesome-local-llm
Awesome Local LLM homepage screenshot

About Awesome Local LLM

This GitHub repository is a community-curated list of platforms, tools, practices, and resources for running large language models locally. It is open-source and maintained by contributors. The list covers a wide range of local LLM use cases, including inference, training, fine-tuning, retrieval-augmented generation, agent development, and hardware setup, with resources for users of varying skill levels.

Key features

  • Curates local LLM inference platforms and engines
  • Lists open-source local LLM user interfaces
  • Includes resources for local LLM training and fine-tuning
  • Provides guides for retrieval-augmented generation with local models
  • Covers local LLM agent frameworks and browser automation tools
  • Includes hardware and prompt engineering tutorials for local LLMs
Best for: It is most useful for developers, hobbyists, and users seeking to run large language models locally without relying on cloud services.
Good for
  • Open-source, community-updated curated collection of local LLM resources
  • Spans tools and guides for all stages of local LLM deployment and use
  • Includes resources for both beginner and advanced local LLM users

Awesome Local LLM at a glance

Type
Open-source project
Pricing
Not confirmed. Check the site
Open source
Yes · Source code
Language
English
Last checked
Oct 6, 2026 · Online when checked
Listed
Oct 5, 2026

Awesome Local LLM alternatives

Tools and sites you could use instead, ranked by how closely they match.

All 24 alternatives

Popular in AI Directories & Resources

Well-known listings from the same topic.

All 139

Awesome Local LLM FAQ

What is the purpose of this repository?
It curates platforms, tools, practices, and resources for running large language models locally.
What types of local LLM resources are included?
The list covers inference engines, user interfaces, models, RAG tools, agent frameworks, hardware guides, and tutorials.
Can users contribute to this resource list?
Yes, the repository includes a CONTRIBUTING.md file with submission guidelines.
Is something wrong or out of date?

Tell us and an editor will check it.

Own this website?

Claim the listing and suggest updates yourself. An editor checks every claim first.

Claim this listing