MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
Open source
24 alternativesLMFlow
Extensible Toolkit for Finetuning and Inference of Large Foundation Models.
About LMFlow
LMFlow is an open-source Python toolkit for finetuning and inference of large foundation models. The project describes itself as an extensible, convenient, and efficient toolbox for finetuning large machine learning models. Its stated design goals are ease of use, speed, and reliability.
The repository's news history lists support for full tuning and LoRA tuning, Flash Attention-2, long context inference for LLaMA models, speculative decoding, custom optimizers, and preset conversation templates. A 2025 major update added full Accelerate support and streamlined the codebase. Users who need the earlier version can use the v0.0.10 branch. Pricing is unknown.
Key features
- Full tuning and LoRA tuning for finetuning language models
- Flash Attention-2 support
- Long context inference using position interpolation for LLaMA models
- Speculative decoding for inference acceleration
- Custom optimizer training with a variety of optimizers
- Preset conversation templates, including Llama-3, Phi-3, and chatml
Best for: Developers and researchers who want an open-source Python toolkit for finetuning and running inference on large language models.
Good for
- Open-source project with its code hosted on GitHub
- Supports several model families, including Llama2, ChatGLM2, and Baichuan, according to its 2023 release notes
- Available as a PyPI package named lmflow-finetune
Watch out for
- The online demo runs on a single GPU, so users may see queuing or 'application busy' messages when many people access it at once
- The 2025 major update changed the codebase, so earlier workflows may require the v0.0.10 branch
LMFlow at a glance
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 6, 2026 · Online when checked
- Listed
- Oct 5, 2026
LMFlow alternatives
Tools and sites you could use instead, ranked by how closely they match.
DyNet provides tools for building dynamic neural networks and deep learning models.
Open source
24 alternatives
GPT-NeoX implements model parallel autoregressive transformers on GPUs using Megatron and DeepSpeed libraries.
Open source
24 alternatives
The colibri-core NLP tool and library works with n-grams, skipgrams, and other linguistic patterns.
Open source
24 alternatives
Gymnasium provides a standard API for single agent reinforcement learning environments and related utilities.
Open source
24 alternatives
DEAP provides a Python framework for prototyping evolutionary computation algorithms and testing new ideas.
Open source
24 alternativesPopular in AI Infrastructure & MLOps
Well-known listings from the same topic.
Guild AIguild.aiFlow AIflow-ai.comsystemprompt.iosystemprompt.ioCoreWeavecoreweave.comKili Technologykili-technology.comAPI docsdocs.x.ai
LMFlow FAQ
How can I install LMFlow with pip?
The project is available on PyPI. The repository's news notes say to install it with pip install lmflow-finetune.
Is an earlier version of LMFlow still available?
Yes. The repository says the previous version can be retrieved with git checkout v0.0.10 or by using the v0.0.10 branch.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.