The shimmytok project provides a pure Rust GGUF tokenizer compatible with llama.cpp and ready for WebAssembly.
FreeOpen source
24 alternativesrust-bert
vsTwitter Text Java
rust-bert vs Twitter Text Java
How do rust-bert and Twitter Text Java compare? Here are the facts side by side: pricing, platforms, open-source status and what each one is for.
| Directory detail | rust-bert | Twitter Text Java |
|---|---|---|
| What it is | Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...). | The Twitter Text Java library tokenizes and parses text according to platform text requirements. |
| Website | ||
| Type | Open-source project | Open-source project |
| Topic | ||
| Pricing | Not confirmed | Not confirmed |
| Platforms | Not recorded | Not recorded |
| Open source | Yes | Yes |
| Language | English | English |
| Alternatives |
Other options to consider
Sites similar to both rust-bert and Twitter Text Java.
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.
Open source
24 alternatives
rb-libsvm provides Ruby bindings for the LIBSVM machine learning library.
Open source
24 alternatives
ML.NET provides an open source, cross platform machine learning framework for .NET applications.
Open source
24 alternatives
Frog combines memory based NLP modules for Dutch, including tagging, lemmatization, morphology analysis, and dependency parsing.
Open source
24 alternatives
JEnv for Windows switches the active Java version with a short command.
Open source
24 alternatives