H2O Sparkling Water

github.com/h2oai/sparkling-water Developer Tools Open-source projectOpen source

Sparkling Water brings H2O machine learning functionality into an Apache Spark cluster.

github.com/h2oai/sparkling-water
H2O Sparkling Water homepage screenshot

About H2O Sparkling Water

Sparkling Water is an open-source library that integrates the H2O-3 machine learning engine with an Apache Spark cluster. It provides utilities for publishing Spark data structures (RDDs, DataFrames and Datasets) as H2O-3 frames and the reverse, a DSL for using Spark data structures as input to H2O algorithms, and building blocks for creating machine learning applications with both Spark and H2O APIs. It is distributed as a Spark application library, with an additional zip distribution bundling the library and shell scripts. Usage options include the Sparkling Shell, a Sparkling Water driver for spark-submit, or including the library in a Spark or PySpark job via --jars or --packages. A Python interface, PySparkling, allows direct use from PySpark. Releases and per-version builds are provided for Spark 3.5 and earlier versions down to 2.3.

Key features

  • Converts Spark RDDs, DataFrames and Datasets to H2O-3 frames and back
  • DSL for using Spark data structures as input to H2O algorithms
  • Python interface (PySparkling) for use directly from PySpark
  • Distributed as a Spark application library and a zip with shell scripts
  • Sparkling Shell and spark-submit driver usage options
  • Per-version builds for Spark 3.5 back through 2.3
Best for: Data engineers and data scientists working with both Spark and H2O-3 who need to move data and run H2O algorithms inside a Spark cluster.
Good for
  • Open-source repository with public source code
  • Supports a range of Spark versions from 2.3 to 3.5
  • Releases are published to Maven Central and can be added with --jars or --packages
Watch out for
  • Requires an existing Spark installation or cluster, configured via SPARK_HOME
  • Version-specific documentation, downloads and builds mean the matching Spark version must be selected

H2O Sparkling Water at a glance

Type
Open-source project
Pricing
Not confirmed. Check the site
Open source
Yes · Source code
Language
English
Last checked
Oct 6, 2026 · Online when checked
Listed
Oct 5, 2026

H2O Sparkling Water alternatives

Tools and sites you could use instead, ranked by how closely they match.

All 24 alternatives

Popular in Developer Tools

Well-known listings from the same topic.

All 423

H2O Sparkling Water FAQ

Which Spark versions are covered?
Documentation, downloads and gradle property files are provided for Spark 3.5, 3.4, 3.3, 3.2, 3.1, 3.0, 2.4 and 2.3.
Can Sparkling Water be used from Python?
Yes. It can be used directly from PySpark through an integration called PySparkling.
How is the library added to a Spark job?
Options include the Sparkling Shell, the Sparkling Water driver with spark-submit, or including the library in a Spark or PySpark job via the --jars or --packages option. Releases are also published to Maven Central.
Is something wrong or out of date?

Tell us and an editor will check it.

Own this website?

Claim the listing and suggest updates yourself. An editor checks every claim first.

Claim this listing