The shimmytok project provides a pure Rust GGUF tokenizer compatible with llama.cpp and ready for WebAssembly.
FreeOpen source
24 alternativesrust-bert
vsFernflower
rust-bert vs Fernflower
How do rust-bert and Fernflower compare? Here are the facts side by side: pricing, platforms, open-source status and what each one is for.
| Directory detail | rust-bert | Fernflower |
|---|---|---|
| What it is | Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...). | Decompile Java bytecode to Java source with Fernflower, used in IntelliJ IDEA. |
| Website | ||
| Type | Open-source project | Open-source project |
| Topic | ||
| Pricing | Not confirmed | Not confirmed |
| Platforms | Not recorded | Not recorded |
| Open source | Yes | Yes |
| Language | English | English |
| Alternatives |
Other options to consider
Sites similar to both rust-bert and Fernflower.
ML.NET provides an open source, cross platform machine learning framework for .NET applications.
Open source
24 alternatives
The Twitter Text Java library tokenizes and parses text according to platform text requirements.
Open source
24 alternatives
Explore GitHub Awesome lists through AwesomeExplorer, a web app for finding repositories and resources.
Open source
24 alternatives
JEnv for Windows switches the active Java version with a short command.
Open source
24 alternatives
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.
Open source
24 alternatives