# About Spark Acceleration Compare

About, read 10 Nov 2026

**The short answer.** Spark Acceleration Compare is a reference publication on ways to make Apache Spark faster without rewriting jobs. It covers twelve options, from Apache plugins to GPU, FPGA and custom-silicon accelerators and cloud runtimes, and keeps two original tables: the Spark Accelerator Ledger of published benchmarks and the Change Budget of what each option makes a team change.

## What it publishes

Option pages with sourced facts, side-by-side comparisons of two options, five situation pages, guides, a glossary, news items with dates, an FAQ and downloadable datasets. The [Ledger](/ledger/) and the [Change Budget](/change-budget/) are the two original tables.

## How it is made

Each fact is taken from a page that was fetched and read on a stated date, and the page is linked. The [method page](/method/) sets out the sourcing, labelling and ordering rules. The site lists options and does not rank them.

## Who it is for

The reader it is written for is a data engineer who owns a Spark cluster and its bill, and wants to see what is published about each option before running a trial.

## Sources

- Amazon EMR runtime for Apache Spark: aws.amazon.com/emr/features/spark: https://aws.amazon.com/emr/features/spark/ (read 10 Nov 2026)
- Apache Auron: auron.apache.org: https://auron.apache.org/ (read 10 Nov 2026)
- Apache DataFusion Comet: datafusion.apache.org/comet: https://datafusion.apache.org/comet/ (read 10 Nov 2026)
- Apache Gluten with Velox: gluten.apache.org: https://gluten.apache.org/ (read 10 Nov 2026)
- Databricks Photon: databricks.com: https://www.databricks.com/ (read 10 Nov 2026)
- DataPelago: datapelago.ai: https://www.datapelago.ai/ (read 10 Nov 2026)
- DualBird: dualbird.io: https://dualbird.io/ (read 10 Nov 2026)
- Flarion: flarion.io: https://www.flarion.io/ (read 10 Nov 2026)
- Google Cloud Lightning Engine: docs.cloud.google.com/managed-spark/docs/guides/lightning-engine: https://docs.cloud.google.com/managed-spark/docs/guides/lightning-engine (read 10 Nov 2026)
- Microsoft Fabric native execution engine: learn.microsoft.com/en-us/fabric/data-engineering/native-execution-engine-overview: https://learn.microsoft.com/en-us/fabric/data-engineering/native-execution-engine-overview (read 10 Nov 2026)
- NVIDIA cuDF plugin for Apache Spark: docs.nvidia.com/spark-rapids/user-guide/latest/index.html: https://docs.nvidia.com/spark-rapids/user-guide/latest/index.html (read 10 Nov 2026)
- Speedata: speedata.io: https://www.speedata.io/ (read 10 Nov 2026)

Last reviewed 10 Nov 2026. Canonical: https://sparkaccelerationcompare.com/about/
