The Featuretools Python library supports automated feature engineering and is published as open source.
Dedupe
A python library for accurate and scalable fuzzy matching, record deduplication and entity-resolution.

About Dedupe
Dedupe is an open-source Python library that uses machine learning for fuzzy matching, deduplication and entity resolution on structured data. It takes human-provided training data and derives rules to find similar records in a dataset.
It can remove duplicate names and addresses, link separate lists such as customer information and order history without shared IDs, and group records where names were entered slightly differently. It is installed with pip install dedupe and used through its Python API.
Key features
- Fuzzy matching of structured records using machine learning
- Deduplication of duplicate names and addresses
- Record linkage across lists without unique IDs
- Learns matching rules from human-provided training data
- csvdedupe command-line tool for CSV deduplication and linking
- Installable with pip install dedupe
- Released as open source under the MIT License
- Learns dataset-specific matching rules from human training examples
- Provides example projects and a CSV command-line tool
- Requires Python to install and use the library
- Needs human-provided training data to learn matching rules
- Designed for structured data
Dedupe at a glance
- Website
- github.com/dedupeio/dedupe
- Category
- AI & Machine Learning › AI Data & Analytics
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 5, 2026 · Online when checked
- Listed
- Oct 5, 2026
Dedupe alternatives
Tools and sites you could use instead, ranked by how closely they match.
An open source Python library for drift detection in machine learning systems.
The lightly Python library supports self supervised learning on images.
nilearn provides Python tools for machine learning and neuroimaging analysis.
A Python package to assess and improve fairness of machine learning models.
Feature Engine provides Python tools for feature engineering and selection that are compatible with scikit-learn.
Popular in AI Data & Analytics
Well-known listings from the same topic.
Dedupe FAQ
How do I install Dedupe for use?
What is csvdedupe?
How do I report a bug?
Tell us and an editor will check it.
Claim the listing and suggest updates yourself. An editor checks every claim first.












