jieba
Segment Chinese text with jieba, a Python package for natural language processing.
About jieba
jieba is a Python package for segmenting Chinese text into words. It provides precise, full, search-engine, and PaddlePaddle-based segmentation modes, with support for traditional Chinese, HMM-based handling of unknown words, and TF-IDF keyword extraction.
Developers can load custom dictionaries, adjust word frequencies in code, and create separate tokenizers with different dictionaries. Paddle mode requires a separate paddlepaddle-tiny install and jieba v0.40 or later, and direct GBK string input is not recommended because of decoding errors.
Key features
- Precise, full, search-engine, and Paddle segmentation modes
- Traditional Chinese text segmentation support
- Custom user dictionary loading with word frequency and tag
- Dynamic dictionary editing via add, delete, frequency suggestion
- TF-IDF keyword extraction with topK and part-of-speech filter
- HMM-based unknown-word recognition using Viterbi algorithm
Best for: Python developers who need to segment Chinese text for text analysis or search indexing.
Good for
- Supports four segmentation modes for different tasks
- Allows custom dictionaries and in-program word adjustments
- MIT-licensed open-source code compatible with Python 2 and 3
Watch out for
- Paddle mode needs separate paddlepaddle-tiny install and jieba v0.40 or later
- Direct GBK string input may decode incorrectly to UTF-8
- Auto-calculated word frequency may not work with HMM new-word discovery
jieba at a glance
- Website
- github.com/fxsjy/jieba
- Category
- Development › Developer Tools
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 5, 2026 · Online when checked
- Listed
- Oct 5, 2026
Guides for Developer Tools
jieba alternatives
Tools and sites you could use instead, ranked by how closely they match.
TextCL provides preprocessing tools for cleaning text data used in natural language processing tasks.
Open source
24 alternatives
Segment Chinese text in PHP applications with jieba-php, a library for Chinese word tokenization.
Open source
24 alternatives
spaCy provides Python natural language processing tools for entity recognition, tagging, parsing, and word vectors.
Free
24 alternatives
Python package and project management is handled by uv, a Rust-based tool.
Open source
24 alternatives
Use Intake, a Python package, to find, load, and share data in data science projects.
Open source
24 alternatives
Python code can be analyzed with pylyzer, a static analyzer and language server.
Open source
24 alternativesPopular in Developer Tools
Well-known listings from the same topic.
AppDevToolsappdevtools.comCommand Not Foundcommand-not-found.comTestFlighttestflight.apple.com/join/A8GwCnq8Sourcegraphabout.sourcegraph.comProject Wallaceprojectwallace.comCarbon Calculatorwebsitecarbon.com
jieba FAQ
How do I install jieba?
It is compatible with Python 2/3. Install with pip install jieba, then reference it with import jieba.
How do I add custom words?
Use jieba.load_userdict(file_name). Each line lists word, optional frequency, and optional tag separated by spaces, and the file must be UTF-8 encoded.
What is needed to use Paddle mode?
Install paddlepaddle-tiny==1.6.1 and use jieba v0.40 or later. Call jieba.enable_paddle(), then pass use_paddle=True to jieba.cut.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.