WhisperS2T is an optimized speech-to-text pipeline for the Whisper model with support for multiple inference engines.
KubeAI
KubeAI serves machine learning models on Kubernetes, including speech to text, language, vision, and embedding models.

About KubeAI
KubeAI is an AI inference operator for Kubernetes that deploys and scales machine learning models, including LLMs, vision-language models, embeddings, reranking, and speech-to-text. It uses a model operator to manage backend server pods, model downloads, volume mounts, and LoRA adapters, plus a proxy that provides an OpenAI-compatible API with request queueing and retries.
It supports vLLM and Ollama for LLMs, FasterWhisper for transcription, and Infinity for embeddings. It runs on CPU, GPU, or TPU in a Kubernetes cluster and does not require Istio, Knative, or a Prometheus metrics adapter.
Key features
- Operate vLLM and Ollama servers for LLM inference
- Transcribe audio with FasterWhisper via audio transcription endpoint
- Generate vector embeddings with Infinity models
- Reorder search results with cross-encoder reranking models
- Scale model replicas from zero based on demand
- Provide OpenAI-compatible API for chat, embeddings, and transcription
- Operates without requiring Istio, Knative, or Prometheus metrics adapter
- Supports CPU, GPU, and TPU hardware
- Queues requests during scale-from-zero and retries failed backends
KubeAI at a glance
- Category
- AI & Machine Learning › AI Speech Transcription
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 5, 2026 · Online when checked
- Listed
- Oct 5, 2026
KubeAI alternatives
Tools and sites you could use instead, ranked by how closely they match.
OpenQuack provides local voice dictation on macOS, inserting Whisper transcripts at the cursor.
The whisper.cpp repository provides a C and C++ port of OpenAI’s Whisper model.
VEED generates subtitles for video and audio, with language and social video options.
Smallest AI provides APIs for text-to-speech, speech-to-text, and voice agents.
Rev AI provides a developer-focused API for converting speech into text.
Popular in AI Speech Transcription
Well-known listings from the same topic.
KubeAI FAQ
What do I need to run KubeAI?
Does KubeAI work with OpenAI client libraries?
How does KubeAI handle scaling and routing?
Tell us and an editor will check it.
Claim the listing and suggest updates yourself. An editor checks every claim first.












