1
Also covers machine learning, open source, and programming · same kind of open-source project
ML.NET provides an open source, cross platform machine learning framework for .NET applications.
Alternatives
The Best shimmytok Alternatives in 2026
24 alternatives0 free · 17 open source
Looking for something like shimmytok? Here are 24 alternatives, ranked by how closely they match it on purpose, features and platforms. Of these, 17 are open source.
The shimmytok project provides a pure Rust GGUF tokenizer compatible with llama.cpp and ready for WebAssembly.
Top picks at a glance
First suggestionML.NETML.NET provides an open source, cross platform machine…Another optionXGBoostScalable, Portable and Distributed Gradient Boosting (GBDT…
Quick comparison
| # | Alternative | Pricing | Open source | Platforms |
|---|---|---|---|---|
| 1 | ML.NET | — | Yes | — |
| 2 | XGBoost | — | Yes | — |
| 3 | rb-libsvm | — | Yes | — |
| 4 | LMQL | — | Not stated | Web |
| 5 | MLJ | — | Not stated | — |
| 6 | Treat | — | Not stated | — |
| 7 | rust-bert | — | Yes | — |
| 8 | OpenNLP | — | Not stated | Web |
| 9 | Python | — | Not stated | Web |
| 10 | scikit-learn | — | Not stated | Web |
All shimmytok alternatives
2
Also covers machine learning, open source, and programming · same kind of open-source project
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.
3
Also covers machine learning, open source, and programming · same kind of open-source project
rb-libsvm provides Ruby bindings for the LIBSVM machine learning library.
4
LMQL
lmql.aiAlso covers llm and programming · same kind of open-source project
LMQL provides a programming language for interactions with large language models.
5
MLJ
github.com/alan-turing-institute/MLJ.jlAlso covers machine learning and programming · same kind of open-source project
The MLJ project provides machine learning tools and a framework for Julia.
6
Treat
github.com/louismullie/treatAlso covers machine learning and programming · same kind of open-source project
Treat supplies Ruby developers with a framework for natural language processing.
7
Also covers machine learning and open source · same kind of open-source project
Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...).
8
OpenNLP
opennlp.apache.orgAlso covers machine learning and programming
Apache OpenNLP is a machine learning based toolkit for the processing of natural language text.
9
Python
python.orgAlso covers machine learning and programming
Python.org is the official site for the Python programming language and its documentation.
10
scikit-learn
scikit-learn.orgAlso covers machine learning and programming
The scikit-learn documentation covers machine learning tools and methods for Python.
11
visualml.io
visualml.ioAlso covers machine learning and programming
The visualml.io site introduces a machine learning toolkit built with JavaScript.
12
Also covers open source and programming · same kind of open-source project
Explore GitHub Awesome lists through AwesomeExplorer, a web app for finding repositories and resources.
13
Also covers open source and programming · same kind of open-source project
The Twitter Text Java library tokenizes and parses text according to platform text requirements.
14
Also covers open source and programming · same kind of open-source project
JEnv for Windows switches the active Java version with a short command.
15
Also covers open source and programming · same kind of open-source project
Frog combines memory based NLP modules for Dutch, including tagging, lemmatization, morphology analysis, and dependency parsing.
16
Also covers open source and programming · same kind of open-source project
Decompile Java bytecode to Java source with Fernflower, used in IntelliJ IDEA.
17
Also covers open source and programming · same kind of open-source project
The go-geom package provides geometry types for geospatial applications written in Go.
18
Also covers open source and programming · same kind of open-source project
Retext processes natural language through a plugin based toolkit in the unified JavaScript ecosystem.
19
Also covers open source and programming · same kind of open-source project
MixedModels.jl fits statistical mixed effects models using the Julia programming language.
20
Also covers open source and programming · same kind of open-source project
Natural provides general purpose natural language processing utilities for applications built with Node.js.
21
Also covers open source and programming · same kind of open-source project
pgmpy provides Python tools for causal inference and probabilistic reasoning.
22
Also covers open source and programming · same kind of open-source project
The sentences command line tool tokenizes text into sentences in multiple languages using Go.
23
Also covers open source and programming · same kind of open-source project
The stdlib project provides a numerical library for JavaScript and TypeScript applications.
24
Also covers open source and programming · same kind of open-source project
Use Crystalline, a Language Server Protocol implementation for the Crystal programming language.
No alternatives match this filter.
Alternatives to similar tools
Twitter Text Java24 alternativesAwexplor.github.io24 alternativesJEnv For Windows24 alternativesMixed Models24 alternativesrust-bert24 alternativesOpenNLP24 alternatives
What is the best alternative to shimmytok?
Based on features, tags and platforms, the closest alternatives to shimmytok are ML.NET, XGBoost, and rb-libsvm.
Are there open-source alternatives to shimmytok?
Yes: ML.NET, XGBoost, rb-libsvm, and rust-bert.
Alternatives are suggested from the purpose and features described in our listings. Different pages for the same product appear once. Read each description to check whether it fits your task. How we choose alternatives · Suggest an alternative