togethercomputer/OpenChatKit

OpenChatKit provides an open-source base for creating specialized or general-purpose chat models.

github.com/togethercomputer/OpenChatKit
togethercomputer/OpenChatKit homepage screenshot

About togethercomputer/OpenChatKit

OpenChatKit is an open-source base for creating specialized and general-purpose chat models. It includes instruction-tuned language models, a moderation model, and an extensible retrieval system for adding context from custom repositories. Its models were trained on the OIG-43M training dataset from Together, LAION, and Ontocord.ai.

The repository provides code to train GPT-NeoXT-Chat-Base-20B and Pythia-Chat-Base-7B, fine-tune Llama-2-7B-32K-beta, test inference through a command-line shell, and augment models with a retrieval index. Use requires local setup with PyTorch, Miniconda, Git LFS and model downloads, and loading a model can take some time.

Key features

  • Train GPT-NeoXT-Chat-Base-20B 20B-parameter chat model
  • Fine-tune Llama-2-7B-32K-beta long-context 7B model
  • Train Pythia-Chat-Base-7B 7B-parameter chat model
  • Test inference with command-line shell maintaining conversation history
  • Augment responses with retrieval index from custom repositories
  • Monitor training with Loguru and Weights & Biases
Best for: Developers who want to train, fine-tune, and test open-source chat models locally.
Good for
  • Open-source code for training, fine-tuning, inference, and retrieval augmentation
  • Includes moderation model and retrieval system for custom repositories
  • Pre-trained Pythia-Chat-Base-7B weights available on Hugging Face under Apache 2.0
Watch out for
  • Requires installing PyTorch, Miniconda, Git LFS and creating conda environment
  • Loading the model can take some time
  • Retrieval-augmented models are described as experimental

togethercomputer/OpenChatKit at a glance

Type
Open-source project
Pricing
Not confirmed. Check the site
Open source
Yes · Source code
Language
English
Last checked
Oct 6, 2026 · Online when checked
Listed
Oct 5, 2026

togethercomputer/OpenChatKit alternatives

Tools and sites you could use instead, ranked by how closely they match.

All 24 alternatives

Popular in AI Chatbots & Assistants

Well-known listings from the same topic.

All 238

togethercomputer/OpenChatKit FAQ

How do I chat with Pythia-Chat-Base-7B?
Run python inference/bot.py --model togethercomputer/Pythia-Chat-Base-7B from the repo root, then enter text at the prompt. Use /quit to exit the shell.
What is needed before starting?
Install PyTorch and other dependencies, Miniconda, Git LFS and mamba, then create the OpenChatKit environment from environment.yml.
Where are pre-trained weights for Pythia-Chat-Base-7B?
On Hugging Face as togethercomputer/Pythia-Chat-Base-7B under an Apache 2.0 license.
Is something wrong or out of date?

Tell us and an editor will check it.

Own this website?

Claim the listing and suggest updates yourself. An editor checks every claim first.

Claim this listing