This Unsloth guide introduces the basics and best practices of fine-tuning language models.

docs.unsloth.ai/get-started/fine-tuning-guide
Fine Tuning Guide homepage screenshot

About Fine Tuning Guide

This Unsloth documentation page introduces fine-tuning language models, including supervised fine-tuning, preference optimization, distillation and reinforcement learning. It explains how training on a dataset can add domain-specific knowledge, adjust tone or behavior, and improve accuracy for specific tasks, with examples such as headline sentiment, customer responses and legal texts. It also explains LoRA and QLoRA adapter training and gives guidance on choosing a model and method, suggesting beginners start with a small instruct model such as Llama 3.1 (8B).

Key features

  • Explains supervised fine-tuning, preference optimization, distillation and reinforcement learning
  • Explains LoRA and QLoRA low-rank adapter training and precision differences
  • Guides choosing models and methods, suggesting small instruct models first
  • Lists example uses like headline sentiment, support replies and legal analysis
  • Describes fine-tuning with notebooks on Colab, Kaggle or local setups
  • Clarifies common misconceptions about new knowledge and RAG comparison
Best for: People new to language models who want to understand fine-tuning basics and method choices.
Good for
  • Beginner-friendly overview of fine-tuning basics
  • Covers SFT, preference methods, distillation, RL, LoRA and QLoRA
  • Includes concrete task examples and starting-model guidance

Fine Tuning Guide at a glance

Type
Website
Pricing
Not confirmed. Check the site
Platforms
Web
Open source
Not stated
Language
English
Last checked
Oct 5, 2026 · Online when checked
Listed
Oct 5, 2026

Fine Tuning Guide alternatives

Tools and sites you could use instead, ranked by how closely they match.

All 24 alternatives

Popular in Science, Math & Technology

Well-known listings from the same topic.

All 276

Fine Tuning Guide FAQ

What is fine-tuning?
Customizing a pre-trained model’s behavior, adding domain knowledge, and optimizing performance for specific tasks by training on a dataset.
What is LoRA/QLoRA?
Instead of changing all weights, train small added matrices A and B. LoRA uses 16-bit weights, while QLoRA uses 4-bit quantization to save memory.
What model should a beginner start with?
A small instruct model like Llama 3.1 (8B), then experiment from there.
Is something wrong or out of date?

Tell us and an editor will check it.

Own this website?

Claim the listing and suggest updates yourself. An editor checks every claim first.

Claim this listing