The shimmytok project provides a pure Rust GGUF tokenizer compatible with llama.cpp and ready for WebAssembly.
FreeOpen source
24 alternativesrust-bert
vsAwexplor.github.io
rust-bert vs Awexplor.github.io
How do rust-bert and Awexplor.github.io compare? Here are the facts side by side: pricing, platforms, open-source status and what each one is for.
| Directory detail | rust-bert | Awexplor.github.io |
|---|---|---|
| What it is | Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...). | Explore GitHub Awesome lists through AwesomeExplorer, a web app for finding repositories and resources. |
| Website | ||
| Type | Open-source project | Open-source project |
| Topic | ||
| Pricing | Not confirmed | Not confirmed |
| Platforms | Not recorded | Web |
| Open source | Yes | Yes |
| Language | English | English |
| Alternatives |
Other options to consider
Sites similar to both rust-bert and Awexplor.github.io.
ML.NET provides an open source, cross platform machine learning framework for .NET applications.
Open source
24 alternatives
MixedModels.jl fits statistical mixed effects models using the Julia programming language.
Open source
24 alternatives
The Twitter Text Java library tokenizes and parses text according to platform text requirements.
Open source
24 alternatives
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.
Open source
24 alternatives
JEnv for Windows switches the active Java version with a short command.
Open source
24 alternatives