The shimmytok project provides a pure Rust GGUF tokenizer compatible with llama.cpp and ready for WebAssembly.
FreeOpen source
24 alternativesHow do rust-bert and python-timbl compare? Here are the facts side by side: pricing, platforms, open-source status and what each one is for.
| Directory detail | rust-bert | python-timbl |
|---|---|---|
| What it is | Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...). | python-timbl exposes the TiMBL C++ programming interface to Python scripts. |
| Website | ||
| Type | Open-source project | Open-source project |
| Topic | ||
| Pricing | Not confirmed | Not confirmed |
| Platforms | Not recorded | macOS |
| Open source | Yes | Yes |
| Language | English | English |
| Alternatives |
Sites similar to both rust-bert and python-timbl.
The shimmytok project provides a pure Rust GGUF tokenizer compatible with llama.cpp and ready for WebAssembly.
Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library.
The machinelearn.js project offers machine learning tools for web applications and Node.js.
ML.NET provides an open source, cross platform machine learning framework for .NET applications.
The Cybertron Go package provides an interface for NLP technologies and pretrained Transformer models.
Tribuo provides machine learning tools in Java, according to its project title.