The project is now called Apache Gluten and its homepage describes it as an Apache Top-Level Project. The GitHub repo apache/incubator-gluten now resolves to apache/gluten. Velox is Meta's C++ library; a Gluten release note says the Velox fork reference moved from oap-project to IBM.
Read
10 Nov 2026
What it does well
Gluten needs no DataFrame or SQL changes, only configuration: the GlutenPlugin class, off-heap memory and the columnar shuffle manager.
The repository includes the gluten-it tool for data generation, query runs and result comparison on Spark 3.4, 3.5, 4.0 and 4.1 profiles.
Where it is limited
The docs name Spark 3.4.4, 3.5.5, 4.0.2 and 4.1.1 as officially supported and warn that an unofficial Spark version can throw NoSuchMethodError at runtime.
Per the Velox backend docs, Iceberg support is read-only, Hudi support covers copy-on-write tables only, and ANSI mode always falls back to vanilla Spark.
Published speed results
Fact
Source type
Source, read
The project homepage reports TPC-H and TPC-DS at 3 TB on Intel Xeon Platinum 8592+ with Spark 3.3.1: overall 3.34x on TPC-H (up to 23.45x on single queries) and 3.02x on TPC-DS (up to 13.75x on single queries). The page does not link a method or scripts for these numbers; the hardware is from Intel, a contributor.
Gluten is a Spark plugin that needs no DataFrame or SQL changes, only configuration: spark.plugins=org.apache.gluten.GlutenPlugin, off-heap memory enabled with a size, ColumnarShuffleManager and the bundle jar.
Unsupported operators fall back to vanilla Spark through columnar-to-row and row-to-columnar conversions. The Velox backend limitations page lists known fallbacks and differences: ANSI mode always falls back, case-sensitive mode may give wrong results, regexp functions use RE2 (no lookaround), file scans fully support only Parquet and partly ORC, partitioned scans need partition info in the path, and JSON functions differ for single-quoted strings.
Off-heap memory must be enabled and sized (the quick start uses spark.memory.offHeap.size=20g and says to adjust it for the environment), and the columnar shuffle manager is needed for native shuffle. Docs also describe a troubleshooting page, Celeborn and Uniffle remote shuffle settings, and a setting (spark.gluten.sql.fallbackRegexpExpressions) for users who cannot tolerate regexp differences. Binary jars must load ahead of Spark's jars because Gluten overrides some Spark classes.
The docs state officially supported Spark versions are 3.4.4, 3.5.5, 4.0.2 and 4.1.1 (Spark 4.x needs JDK 17+ and Scala 2.13). The downloads page still lists Spark 3.3 binaries for 1.6.0 and 1.7.0, and the homepage benchmark used Spark 3.3.1. Using an unofficial Spark version can throw NoSuchMethodError at runtime. Docs do not mention EMR, EKS or Databricks support.
Velox backend docs: Iceberg reads of copy-on-write and merge-on-read tables are supported but the Iceberg page says only reading is supported and only Spark 3.4 is well tested; Hudi supports reading COW tables only; Paimon supports non-primary-key tables only; Delta has a build profile and a doc page. Celeborn 0.3 to 0.5 and Uniffle 0.9.2 remote shuffle are supported.
Official build and test platform is Ubuntu 20.04/22.04 or CentOS 8; the downloads page says binaries were built on CentOS 7 with static linking on Intel Xeon Platinum 8272CL class CPUs, and that performance and compatibility are not guaranteed on other OSes or hardware, so building from source is recommended. Docs have pages for S3, GCS and ABFS storage.
The repo includes the gluten-it integration test and benchmark tool (data generation, query runs, result comparison against a baseline) for building and running TPC-style queries locally, supported on Spark 3.4, 3.5, 4.0 and 4.1 profiles. The homepage TPC-H and TPC-DS numbers do not themselves link to a run configuration.
The Powered By page lists adopters including Alibaba, Baidu, Bytedance, BIGO, IBM, Kyligence, Meituan, Microsoft (Fabric), Google (Lightning engine), Netease, Oracle (OCI), Palantir, Pinterest, SF Express and Tencent. These are self-reported entries. The homepage benchmark runs on Intel hardware; the docs describe Velox as Meta's C++ execution library. Project license is Apache-2.0 (GitHub API).
GitHub releases: v1.7.0 published 2026-08-26 (rc1 2026-08-17). The downloads page lists 1.7.0 as 'Jun. 6 2025', which conflicts with the GitHub date and looks like a typo; 1.6.0 is listed as Mar. 10 2026 and 1.5.0 as Oct. 29 2025. Repo created 2021-12-06, about 1,600 stars.
The settings are spark.plugins=org.apache.gluten.GlutenPlugin, off-heap memory enabled with a size, ColumnarShuffleManager and the bundle jar loaded ahead of Spark's jars.
No cloud requirement is stated. Official build and test platforms are Ubuntu 20.04/22.04 or CentOS 8, and the docs have pages for S3, GCS and ABFS storage.
Any published cost per job or cost-for-the-same-work result (the software is free under Apache-2.0) (searched: gluten.apache.org, raw.githubusercontent.com/apache/gluten/main/docs/index.md, raw.githubusercontent.com/apache/gluten/main/docs/get-started/getting-st)
Documented support or tested configuration for Amazon EMR, EKS or Databricks (searched: raw.githubusercontent.com/apache/gluten/main/docs/backends/velox/get-sta, gluten.apache.org/poweredby, raw.githubusercontent.com/apache/gluten/main/docs/get-started/getting-st)
An independent benchmark of Gluten on AWS hardware (searched: gluten.apache.org, gluten.apache.org/poweredby, gluten.apache.org/community)
Apache Gluten with Velox side by side with each other option