Skip to content
Spark Acceleration Compare

Option profile, read 10 Nov 2026

Apache Auron, Open-source Rust engine plugin for Spark: the published facts

Apache Auron in the LedgerCompare with another option

Kind
Open-source Rust engine plugin for Spark
Website
auron.apache.org
Name checked
Renamed from Blaze to Auron. Releases up to 4.0.1 (Dec 2024) shipped as 'blaze-engine' jars; 5.0.0 (Apr 28 2025) and later are Auron. The GitHub repo kwai/blaze now resolves to apache/auron. Releases 6.0.0, 7.0.0 and 8.0.0 are labeled 'incubating', but the project homepage footer calls it a top-level project, so the project's own pages disagree on status.
Read
10 Nov 2026

What it does well

  • The project publishes its TPC-DS 1 TB method, with data generation and runner tools in the auron-project/tpcds-tools repository and the full Spark configuration.
  • Its build script lists Spark 3.0, 3.1, 3.2, 3.3, 3.4, 3.5, 4.0, 4.1 and 4.2 with Scala 2.12 and 2.13.

Where it is limited

  • You build the jar yourself (Rust nightly and a JDK are required), and the getting-started page describes building from source.
  • Support for Amazon EMR, EKS or Databricks: none found on 2026-11-10 in the project's pages.
  • The benchmark's per-query results are published as a chart image only.

Published speed results

FactSource typeSource, read
The project says it has passed all TPC-DS and TPC-H cases and, compared with Spark 3.5, runs about 2x faster and saves about 50% of cluster resources. The only published detail is the TPC-DS 1 TB benchmark page; no per-query numbers are in text form (results are a chart).open source projectauron.apache.org, 10 Nov 2026

Code changes

FactSource typeSource, read
Auron is added by putting a jar on the Spark classpath and setting spark.auron.enable, the AuronSparkSessionExtension and the AuronShuffleManager; no job changes. The project describes fine-grained fallback for unsupported operators, and the Spark UI has an Auron tab that records per-operator fallback reasons. You must build the jar yourself (Rust nightly and JDK required); the getting-started page describes building from source.open source projectauron.apache.org, 10 Nov 2026

Tuning

FactSource typeSource, read
The suggested config disables Spark off-heap memory and moves memory into executor overhead (4096 MB in the quick start). The benchmark used executor memory 8g with overhead 16384 for Auron versus 20g with 4096 for plain Spark, plus spark.auron.memoryFraction 0.8, forceShuffledHashJoin and sort-merge-join and UDAF fallback settings. ORC with large string/binary values needs spark.auron.orc.batchSize lowered.open source projectauron.apache.org/documents/benchmarks.html, 10 Nov 2026

Spark versions, platforms and table formats

FactSource typeSource, read
The build script lists supported Spark versions 3.0, 3.1, 3.2, 3.3, 3.4, 3.5, 4.0, 4.1 and 4.2 with Scala 2.12 and 2.13, and Celeborn 0.5/0.6 and Uniffle 0.10 remote shuffle. The 8.0.0 notes add Spark 4.0 and 4.1 build support. No EMR, EKS or Databricks support is documented.open source projectraw.githubusercontent.com/apache/auron/master/auron-build.sh, 10 Nov 2026
The 8.0.0-incubating release notes say it added and expanded native scan support for Apache Iceberg, Apache Hudi and Apache Paimon, including Copy-on-Write tables and Iceberg changelog scans. The homepage says it supports Hudi and Paimon. 8.0.0 also adds Flink integration. Delta Lake is not mentioned in the fetched pages.open source projectauron.apache.org/archives/v8.0.0-incubating.html, 10 Nov 2026

Where it runs

FactSource typeSource, read
Build needs Rust nightly and JDK; the README says regularly tested on JDK 8, 11 and 17 and also on JDK 21. The build script supports OS images centos7, ubuntu24, rockylinux8, debian11 and azurelinux3, and macOS builds were added in 8.0.0. The homepage says it supports storage such as HDFS and S3. No cloud-specific instance guidance was found.open source projectraw.githubusercontent.com/apache/auron/master/README.md, 10 Nov 2026

How open its benchmarks are

FactSource typeSource, read
The benchmark page publishes the method end to end: TPC-DS 1 TB data generated with a datagen tool (derived from maropu/spark-tpcds-datagen) and run with a benchmark runner (derived from databricks/spark-sql-perf), both in the auron-project/tpcds-tools repo, with the full Spark config. It ran Spark 3.5.6 against Auron 6.0.0-preview on YARN. Node types and counts are not given (the config shows executor cores 8 and a very large maxExecutors).open source projectauron.apache.org/documents/benchmarks.html, 10 Nov 2026

Company and breadth

FactSource typeSource, read
Apache-2.0 licensed under the Apache Software Foundation; GitHub repo (originally kwai/blaze) created 2021-06-28, about 1,800 stars. The homepage says it is verified in production with exabytes of data; that claim names no company.open source projectauron.apache.org, 10 Nov 2026

Profile

FactSource typeSource, read
Releases: 8.0.0-incubating (2026-07-18), 7.0.0-incubating (2026-03-04), 6.0.0-incubating (2025-10-17), 5.0.0 (2025-04-28), 4.0.1 (2024-12-10), 4.0.0 (2024-10-10), going back to 2.0.6 in Sep 2023 under the Blaze name.open source projectauron.apache.org/archives/all-releases.html, 10 Nov 2026

Ledger entries for Apache Auron

PublishedOptionTestResult as publishedRan byMethod published
Not statedApache AuronAuron TPC-DS 1 TB against Apache Spark 3.5.6Published as 'running ~2x faster and save ~50% cluster resources' against Apache Spark 3.5; per-query results are a chart image onlyApache Auron project (its maker)Yes, tools and full Spark config in the auron-project/tpcds-tools repository

Change Budget row

ColumnWhat changesDetailSource, read
CodeNo job code change statedAuron is added with a jar on the Spark classpath and three settings (spark.auron.enable, the AuronSparkSessionExtension and the AuronShuffleManager); the project states no job changes.Apache Auron homepage, 10 Nov 2026
ClusterBuild the jar, set three configsYou must build the jar yourself (Rust nightly and a JDK). The quick start disables Spark off-heap memory and moves memory into executor overhead (4096 MB).Apache Auron benchmark page, 10 Nov 2026
CloudNone found on 2026-11-10No cloud requirement is stated. The homepage says it supports storage such as HDFS and S3, and no cloud-specific instance guidance was found. Documented support for EMR, EKS or Databricks: none found on 2026-11-10.Apache Auron README, 10 Nov 2026
VendorApache-2.0, no contract statedAuron is Apache-2.0 licensed under the Apache Software Foundation; no vendor or platform contract is described.Apache Auron homepage, 10 Nov 2026

Searched for and none found on 10 Nov 2026

  • Any published cost per job or dollar cost-for-the-same-work result (only a relative 'about 50% cluster resources' claim) (searched: auron.apache.org, auron.apache.org/documents/benchmarks.html, raw.githubusercontent.com/apache/auron/master/README.md)
  • Confirmation that Kuaishou created Blaze or still contributes (not stated on the fetched pages; only the kwai GitHub organization name hints at it) (searched: auron.apache.org, raw.githubusercontent.com/apache/auron/master/README.md, auron.apache.org/archives/v4.0.0.html)
  • Documented support or tested configuration for Amazon EMR, EKS or Databricks (searched: auron.apache.org/documents/getting-started.html, raw.githubusercontent.com/apache/auron/master/README.md)

Apache Auron side by side with each other option

Sources

  1. Apache Auron: auron.apache.org, read 10 Nov 2026
  2. Apache Auron: auron.apache.org/documents/benchmarks.html, read 10 Nov 2026
  3. Apache Auron: raw.githubusercontent.com/apache/auron/master/auron-build.sh, read 10 Nov 2026
  4. Apache Auron: auron.apache.org/archives/v8.0.0-incubating.html, read 10 Nov 2026
  5. Apache Auron: raw.githubusercontent.com/apache/auron/master/README.md, read 10 Nov 2026
  6. Apache Auron: auron.apache.org/archives/all-releases.html, read 10 Nov 2026

Last reviewed 10 Nov 2026.