FEDOT automates machine learning model development through its modeling framework.
Open source
24 alternativesPetastorm
Enables single machine or distributed training and evaluation of deep learning models.
About Petastorm
Petastorm is an open source data access library developed at Uber ATG for training and evaluating deep learning models directly from datasets in Apache Parquet format. It supports TensorFlow, PyTorch, PySpark, and pure Python code on a single machine or in a distributed setup.
Datasets store higher-level schema information for multidimensional arrays and support extensible codecs such as JPEG and PNG. Dataset creation uses PySpark, and extras such as TensorFlow, PyTorch, and OpenCV are not installed automatically.
Key features
- Train and evaluate models from Apache Parquet datasets
- Single-machine or distributed training support
- Works with TensorFlow, PyTorch, PySpark, and pure Python
- Stores multidimensional arrays as native dataset fields
- Extensible codecs including JPEG and PNG compression
- Dataset generation using PySpark locally or on cluster
Best for: Developers training TensorFlow, PyTorch, or PySpark models from Parquet datasets.
Good for
- Supports TensorFlow, PyTorch, PySpark, and pure Python
- Supports single-machine and distributed training and evaluation
- Handles multidimensional arrays with standard and custom codecs
Watch out for
- Framework-specific extras require separate installation
- Dataset creation depends on PySpark
Petastorm at a glance
- Website
- github.com/uber/petastorm
- Type
- Open-source project
- Pricing
- Not confirmed. Check the site
- Open source
- Yes · Source code
- Language
- English
- Last checked
- Oct 5, 2026 · Online when checked
- Listed
- Oct 5, 2026
Petastorm alternatives
Tools and sites you could use instead, ranked by how closely they match.
m2cgen converts machine learning models into native code for multiple programming languages without runtime dependencies.
Open source
24 alternatives
DeepSpeed optimizes distributed training and inference for deep learning models.
Open source
24 alternatives
Auto_ViML builds multiple machine learning models with a single line of code.
Open source
24 alternatives
Hugging Face Accelerate launches and trains PyTorch models across devices and distributed configurations.
Open source
24 alternatives
AutoKeras automates development of deep learning models through a machine learning library.
Open source
24 alternativesPopular in ML Training & Optimization
Well-known listings from the same topic.
Edwardedwardlib.orgAerosolveaerosolve.airbnb.techDataturedatature.ioTogether AItogether.aiOptunaoptuna.orgCatBoostcatboost.ai
Petastorm FAQ
How do I install Petastorm?
Use pip install petastorm, with extras for specific dependencies, for example pip install petastorm[opencv,tf_gpu].
How are Petastorm datasets created?
Datasets are generated using PySpark and stored in Apache Parquet format with additional schema metadata.
Which frameworks does Petastorm support?
TensorFlow, PyTorch, PySpark, and pure Python code.
Is something wrong or out of date?
Tell us and an editor will check it.
Own this website?
Claim this listing
Claim the listing and suggest updates yourself. An editor checks every claim first.