MLOps framework to package, deploy, monitor and manage thousands of production machine learning models.

github.com/SeldonIO/seldon-core
Seldon-core homepage screenshot

About Seldon-core

Seldon Core 2 is an MLOps and LLMOps framework for deploying, managing and scaling AI systems on Kubernetes. It covers single models as well as modular, data-centric applications. According to the project's homepage, it can deploy across a range of model types, on-premises or in any cloud.

The framework includes pipelines for composing AI applications, multi-model serving on shared inference servers, autoscaling, and experiments for routing traffic between candidate models or pipelines. Its custom components can add drift and outlier detection and LLM integration. The project is distributed under the Business Source License, and the directory lists it as not open source. The homepage directs commercial-use inquiries to Seldon's website.

Key features

  • Pipelines that compose AI applications, using Kafka for realtime data streaming between components
  • Autoscaling for models and application components based on native or custom logic
  • Multi-model serving that consolidates several models on shared inference servers
  • Overcommit to deploy more models than available memory allows
  • Experiments that route data between candidate models or pipelines, including A/B tests and shadow deployments
  • Custom components for drift and outlier detection and LLM integration
Best for: Engineering and MLOps teams that run many production machine learning or LLM models on Kubernetes and need a standardized way to deploy and scale them.
Good for
  • Supports deployment across a wide range of model types, on-premises or in any cloud.
  • Multi-model serving lets several models share inference servers.
  • Experiments feature supports A/B tests and shadow deployments between candidate models or pipelines.
Watch out for
  • Built for Kubernetes environments.
  • Distributed under the Business Source License, and the directory lists it as not open source.
  • The homepage directs commercial-use questions to Seldon's website rather than providing terms directly.

Seldon-core at a glance

Type
Open-source project
Pricing
Not confirmed. Check the site
Open source
Not stated
Language
English
Last checked
Oct 6, 2026 · Online when checked
Listed
Oct 5, 2026

Seldon-core alternatives

Tools and sites you could use instead, ranked by how closely they match.

All 24 alternatives

Popular in AI Infrastructure & MLOps

Well-known listings from the same topic.

All 341

Seldon-core FAQ

Can it be deployed on-premises?
The homepage states that Seldon Core 2 can deploy models on-prem or in any cloud.
What license applies to commercial use?
The project is distributed under the Business Source License. The homepage says commercial-use questions should be directed to Seldon through its website.
Is something wrong or out of date?

Tell us and an editor will check it.

Own this website?

Claim the listing and suggest updates yourself. An editor checks every claim first.

Claim this listing