The shimmytok project provides a pure Rust GGUF tokenizer compatible with llama.cpp and ready for WebAssembly.
FreeOpen source
24 alternativesHow do rust-bert and Treat compare? Here are the facts side by side: pricing, platforms, open-source status and what each one is for.
| Directory detail | rust-bert | Treat |
|---|---|---|
| What it is | Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...). | Treat supplies Ruby developers with a framework for natural language processing. |
| Website | ||
| Type | Open-source project | Open-source project |
| Topic | ||
| Pricing | Not confirmed | Not confirmed |
| Platforms | Not recorded | Not recorded |
| Open source | Yes | Not stated |
| Language | English | English |
| Alternatives |
Sites similar to both rust-bert and Treat.
The shimmytok project provides a pure Rust GGUF tokenizer compatible with llama.cpp and ready for WebAssembly.
ML.NET provides an open source, cross platform machine learning framework for .NET applications.
rb-libsvm provides Ruby bindings for the LIBSVM machine learning library.
Apache OpenNLP is a machine learning based toolkit for the processing of natural language text.
Polyglot provides multilingual text processing tools for natural language processing.
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.