The shimmytok project provides a pure Rust GGUF tokenizer compatible with llama.cpp and ready for WebAssembly.
FreeOpen source
24 alternativesrust-bert
vsfrog
rust-bert vs frog
How do rust-bert and frog compare? Here are the facts side by side: pricing, platforms, open-source status and what each one is for.
| Directory detail | rust-bert | frog |
|---|---|---|
| What it is | Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...). | Frog combines memory based NLP modules for Dutch, including tagging, lemmatization, morphology analysis, and dependency parsing. |
| Website | ||
| Type | Open-source project | Open-source project |
| Topic | ||
| Pricing | Not confirmed | Not confirmed |
| Platforms | Not recorded | Linux, macOS |
| Open source | Yes | Yes |
| Language | English | English |
| Alternatives |
Other options to consider
Sites similar to both rust-bert and frog.
ML.NET provides an open source, cross platform machine learning framework for .NET applications.
Open source
24 alternatives
Explore GitHub Awesome lists through AwesomeExplorer, a web app for finding repositories and resources.
Open source
24 alternatives
The Twitter Text Java library tokenizes and parses text according to platform text requirements.
Open source
24 alternatives
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.
Open source
24 alternatives
JEnv for Windows switches the active Java version with a short command.
Open source
24 alternatives