The shimmytok project provides a pure Rust GGUF tokenizer compatible with llama.cpp and ready for WebAssembly.
FreeOpen source
24 alternativesrust-bert
vsPython
rust-bert vs Python
How do rust-bert and Python compare? Here are the facts side by side: pricing, platforms, open-source status and what each one is for.
| Directory detail | rust-bert | Python |
|---|---|---|
| What it is | Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...). | Python.org is the official site for the Python programming language and its documentation. |
| Website | ||
| Type | Open-source project | Website |
| Topic | ||
| Pricing | Not confirmed | Not confirmed |
| Platforms | Not recorded | Web |
| Open source | Yes | Not stated |
| Language | English | English |
| Alternatives |
Other options to consider
Sites similar to both rust-bert and Python.
ML.NET provides an open source, cross platform machine learning framework for .NET applications.
Open source
24 alternatives
Apache OpenNLP is a machine learning based toolkit for the processing of natural language text.
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.
Open source
24 alternatives
Treat supplies Ruby developers with a framework for natural language processing.
The scikit-learn documentation covers machine learning tools and methods for Python.