Petals
petals.devPetals runs large language models at home through a BitTorrent-style approach and supports text generation and fine-tuning.
Looking for something like Petals? Here are 24 alternatives, ranked by how closely they match it on purpose, features and platforms. Of these, 20 are open source.
Petals runs large language models across distributed computers and supports fine-tuning and inference.
| # | Alternative | Pricing | Open source | Platforms |
|---|---|---|---|---|
| 1 | Petals | — | Not stated | Web |
| 2 | LLM-API-Key-Proxy | — | Not stated | — |
| 3 | ChatGLM2-6B | — | Not stated | — |
| 4 | LocalAI | — | Yes | Web |
| 5 | Jan | — | Yes | — |
| 6 | Gpt4all | — | Yes | Linux, macOS, Windows |
| 7 | LLMFlows | — | Yes | — |
| 8 | Lollms Webui | — | Yes | — |
| 9 | Generative AI Docs | — | Yes | — |
| 10 | DeepPavlov | — | Yes | Linux, macOS, Windows |
Petals runs large language models at home through a BitTorrent-style approach and supports text generation and fine-tuning.
LLM-API-Key-Proxy provides a gateway for multiple language model APIs, with compatible endpoints and provider translation.
This bilingual chat language model is described in English and Chinese on the ChatGLM2-6B repository page.
LocalAI runs text, voice, vision, image, video, and agent workloads through an open-source AI engine.
Jan runs an offline AI chat assistant on a personal computer as an open-source ChatGPT alternative.
GPT4All runs language models locally on a range of devices through open-source software.
LLMFlows provides components for building language model applications with explicit workflows.
Lollms Webui provides a web user interface for large language and multimodal systems.
TextFX is a deprecated AI experiment from Google Creative Lab for exploring language and text.
Build dialogue systems and chatbots with DeepPavlov, an open-source NLP framework using PyTorch and transformer models.
Intelli builds chatbots and agents from user-defined intents and model choices.
LocalGPT lets users chat with documents on their local device using GPT models.
OpenChatKit provides an open-source base for creating specialized or general-purpose chat models.
PrivateGPT provides an API layer for private AI applications using local models, retrieval, tools, and MCP.
alphaXiv helps users discover, read, and discuss arXiv papers, with research answers grounded in the underlying work.
Open WebUI provides a self hosted platform for connecting AI models and extending the interface with code.
Pipecat provides an open-source framework for developing real-time voice agents and multimodal AI applications.
Jupyter AI adds an AI chat interface and agent capabilities to JupyterLab notebooks.
py-vectara-agentic is a Python library for creating AI assistants with Vectara using agentic retrieval-augmented generation.
This HR chatbot answers user questions with tools through an autonomous agent workflow.
This project describes serving an LLM as a chatbot service through a multi-agent framework.
RasaGPT is the first headless LLM chatbot platform built on top of Rasa and Langchain.
Run Leon, an open-source personal assistant, on a server managed by the user.
SillyTavern is a frontend for users working with large language models.
Alternatives are suggested from the purpose and features described in our listings. Different pages for the same product appear once. Read each description to check whether it fits your task. How we choose alternatives · Suggest an alternative