Microsoft ML for Apache Spark
SynapseML provides distributed machine learning algorithms for Spark through its Python library.
About Microsoft ML for Apache Spark
SynapseML, previously known as MMLSpark, is an open-source Python library for distributed machine learning on Apache Spark. It is built on the Spark distributed computing framework and uses the same API as SparkML/MLLib, so its models can be used inside existing Spark workflows.
With it, you can build machine learning pipelines for tasks such as text analytics, computer vision, anomaly detection, and deep learning. It supports training and evaluation on single-node, multi-node, and resizable clusters. It can be used from Python, R, Scala, Java, and .NET, and works with different databases, file systems, and cloud data stores. Included modules cover areas such as LightGBM on Spark, Vowpal Wabbit on Spark, ONNX on Spark, HTTP on Spark, and Spark Serving.
It suits data scientists and developers who already work with Spark and need distributed tools for large datasets. Installation requires matching language wrapper and JVM artifacts to the Spark and Scala version in use.
Key features
- Distributed ML APIs compatible with SparkML/MLLib workflows
- Pipelines for text, vision, anomaly detection and deep learning
- Training on single-node, multi-node and resizable clusters
- Usable from Python, R, Scala, Java and .NET
- Includes LightGBM, Vowpal Wabbit and ONNX on Spark
- HTTP on Spark for distributed microservice orchestration
Best for: Data scientists and developers building distributed ML pipelines on existing Apache Spark workflows.
Good for
- Open-source library built on Apache Spark
- Compatible with SparkML/MLLib API
- Supports Python, R, Scala, Java and .NET
- Works with multiple databases and cloud data stores
Watch out for
- Requires matching JVM artifacts for Spark version
- Installing Python wrapper alone does not include JVM artifacts
Microsoft ML for Apache Spark at a glance
- Category
- Development › Developer Tools
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 5, 2026 · Online when checked
- Listed
- Oct 5, 2026
Guides for Developer Tools
Microsoft ML for Apache Spark alternatives
Tools and sites you could use instead, ranked by how closely they match.
mlxtend adds helper modules for Python data analysis and machine learning libraries.
Machine learning pipelines can use whylogs, an open-source library for logging data quality and model performance.
Open source
24 alternatives
Class-imbalanced machine learning is supported by imbalanced-ensemble, a toolbox for ensemble methods and datasets.
Open source
24 alternatives
The Geni project provides a Clojure dataframe library that runs on Apache Spark.
Open source
24 alternatives
Python developers can use gensim for topic modeling and related natural language processing tasks.
Open source
24 alternatives
jSciPy provides Java scientific computing tools for signal processing, FFT, filtering, power spectral density, and DCT.
Open source
24 alternativesPopular in Developer Tools
Well-known listings from the same topic.
AppDevToolsappdevtools.comCommand Not Foundcommand-not-found.comTestFlighttestflight.apple.com/join/A8GwCnq8Sourcegraphabout.sourcegraph.comProject Wallaceprojectwallace.comCarbon Calculatorwebsitecarbon.com
Microsoft ML for Apache Spark FAQ
What is SynapseML?
It is an open-source library for distributed machine learning on Apache Spark, previously known as MMLSpark.
Is SynapseML compatible with SparkML?
Yes, it shares the same API as SparkML/MLLib and can be used in existing Apache Spark workflows.
Which languages does SynapseML support?
It is usable across Python, R, Scala, Java, and .NET.
How do I select the correct SynapseML build?
You need both the language wrapper and matching JVM artifacts. Spark 3.5 uses Scala 2.12, while Spark 4.0 and 4.1 use Scala 2.13.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.