# Databricks Photon, Databricks's C++ vectorized engine: the published facts

Option profile, read 10 Nov 2026

**The short answer.** Photon is the C++ vectorized query engine inside Databricks compute, documented on AWS, Azure and Google Cloud. Databricks's documentation says it works with existing Spark API code and is on by default for classic jobs compute. Databricks announced an audited 100 TB TPC-DS result of 32,941,245 QphDS in November 2021.

- **Kind:** Databricks's C++ vectorized engine
- **Website:** [www.databricks.com](https://www.databricks.com/)
- **Name checked:** Still called Photon in current Databricks docs (page last updated Sep 11, 2026). Documented as the Databricks-native vectorized query engine; the page describes it only inside Databricks compute (serverless, SQL warehouses, classic all-purpose and jobs compute, Lakeflow pipelines). No offering outside Databricks was found on this page.
- **Read:** 10 Nov 2026

## What it does well

- Per Databricks's documentation, Photon works with existing Spark API code with no changes, and it is on by default for classic all-purpose and jobs compute.
- Databricks announced a TPC-audited 100 TB TPC-DS result of 32,941,245 QphDS in November 2021.

## Where it is limited

- Photon is documented only as part of Databricks compute and is not offered as a standalone engine for open source Spark or EMR.
- Per the same documentation, Photon does not support UDFs, RDD APIs or Dataset APIs, and stateful streaming is not supported.

## Published speed results

| Fact | Source type | Source, read |
| --- | --- | --- |
| Docs claim up to 5x better price/performance for data and analytics workloads compared to other cloud data warehouses, as measured by industry-standard TPC-DS benchmarks. This compares against warehouses, not against open source Spark. | vendor docs | [docs.databricks.com/en/compute/photon.html](https://docs.databricks.com/en/compute/photon.html), 10 Nov 2026 |
| The SIGMOD 2022 Photon paper reports customers observed average speedups of 3x over the previous Databricks Runtime and maximum speedups of over 10x. The baseline is Databricks' own prior Spark-based runtime, not open source Spark. | vendor | [people.eecs.berkeley.edu/~matei/papers/2022/sigmod_photon.pdf](https://people.eecs.berkeley.edu/~matei/papers/2022/sigmod_photon.pdf), 10 Nov 2026 |
| Databricks announced an audited 100TB TPC-DS record in November 2021: 32,941,245 QphDS versus 14,861,137 for the previous record holder (Alibaba). The post says Databricks SQL 'is not based on Apache Spark, but rather Photon'. The run was on Databricks SQL, not a Spark batch job. | vendor | [databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing](https://www.databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing-performance-record.html), 10 Nov 2026 |

## Published cost results and prices

| Fact | Source type | Source, read |
| --- | --- | --- |
| Photon instance types consume DBUs at a different rate than the same instance without Photon, so cost depends on the DBU multiplier on the pricing page, not only on speedup. Databricks defines a DBU as a normalized unit of processing power used for pricing. | vendor docs | [databricks.com/product/pricing](https://www.databricks.com/product/pricing), 10 Nov 2026 |

## Code changes

| Fact | Source type | Source, read |
| --- | --- | --- |
| Docs say Photon works with existing Spark API code with no changes. Unsupported operations fall back transparently to the Spark runtime for the remainder of that operation. Photon does not support UDFs, RDD APIs or Dataset APIs, and stateful streaming is not supported. | vendor docs | [docs.databricks.com/en/compute/photon.html](https://docs.databricks.com/en/compute/photon.html), 10 Nov 2026 |

## Tuning

| Fact | Source type | Source, read |
| --- | --- | --- |
| Photon is on by default for classic all-purpose, jobs compute and classic pipelines (checkbox Use Photon Acceleration), and enabled on serverless and SQL warehouses. If you use the Clusters or Jobs API you must set runtime_engine to PHOTON. Queries under about two seconds see no meaningful gain. Users check the Spark UI to see fallback. | vendor docs | [docs.databricks.com/en/compute/photon.html](https://docs.databricks.com/en/compute/photon.html), 10 Nov 2026 |

## Spark versions, platforms and table formats

| Fact | Source type | Source, read |
| --- | --- | --- |
| Photon accelerates Delta Lake, Apache Iceberg and Parquet writes, supports SQL and DataFrame APIs in Python, R, Scala and Java, and stateless streaming from Delta, Parquet, CSV, JSON, Kafka and Kinesis. It runs on Databricks Runtime, so the Spark version is the Databricks Runtime version, not a user choice of open source Spark. | vendor docs | [docs.databricks.com/en/compute/photon.html](https://docs.databricks.com/en/compute/photon.html), 10 Nov 2026 |

## Where it runs

| Fact | Source type | Source, read |
| --- | --- | --- |
| Photon is documented only as part of Databricks compute on AWS, Azure and GCP (cloud tabs on the page). It is not offered as a standalone engine for open source Spark, EMR or other platforms in the docs read. | vendor docs | [docs.databricks.com/en/compute/photon.html](https://docs.databricks.com/en/compute/photon.html), 10 Nov 2026 |
| Photon supports a set of driver and worker instance types including Graviton. Graviton with Photon does not support Databricks Container Services for dedicated compute or SQL warehouses. | vendor docs | [docs.databricks.com/en/compute/photon.html](https://docs.databricks.com/en/compute/photon.html), 10 Nov 2026 |

## How open its benchmarks are

| Fact | Source type | Source, read |
| --- | --- | --- |
| The TPC-DS record is a TPC-audited result, so a full report exists under TPC rules, but it needs a Databricks SQL warehouse and is not a repeatable open script. No public repo for Photon speedups on user Spark jobs was found. | vendor | [databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing](https://www.databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing-performance-record.html), 10 Nov 2026 |

## Company and breadth

| Fact | Source type | Source, read |
| --- | --- | --- |
| Photon is proprietary to Databricks. It was described in a SIGMOD 2022 paper by Databricks engineers. Source code is not open. | vendor | [people.eecs.berkeley.edu/~matei/papers/2022/sigmod_photon.pdf](https://people.eecs.berkeley.edu/~matei/papers/2022/sigmod_photon.pdf), 10 Nov 2026 |

## Profile

| Fact | Source type | Source, read |
| --- | --- | --- |
| Photon is the Databricks-native vectorized query engine. It replaces the JVM Spark SQL execution layer with a C++ runtime for supported operations while Catalyst still plans the query. | vendor docs | [docs.databricks.com/en/compute/photon.html](https://docs.databricks.com/en/compute/photon.html), 10 Nov 2026 |

## Ledger entries for Databricks Photon

| Published | Option | Test | Result as published | Ran by | Method published |
| --- | --- | --- | --- | --- | --- |
| 2022 | [Databricks Photon](/options/databricks-photon/) | [Photon customer speedups, SIGMOD 2022 paper](/ledger/databricks-photon-customer-speedups-sigmod-2022/) | Average speedup of 3x over the previous Databricks Runtime; maximum speedup over 10x | Databricks authors (its maker) | No |
| 2021-11-02 | [Databricks Photon](/options/databricks-photon/) | [Databricks audited 100 TB TPC-DS result on Photon](/ledger/databricks-photon-tpcds-100tb-audited/) | 32,941,245 QphDS at 100 TB, against 14,861,137 QphDS for the previous record holder (Alibaba) | Databricks, audited by the TPC (its maker) | No (a TPC audit report exists under TPC rules; not a repeatable open script) |

## Change Budget row

| Column | What changes | Detail | Source, read |
| --- | --- | --- | --- |
| Code | No change, with listed exceptions | Databricks says Photon works with existing Spark API code with no changes. It does not support UDFs, RDD APIs or Dataset APIs, and stateful streaming is not supported. | [Databricks Photon documentation](https://docs.databricks.com/en/compute/photon.html), 10 Nov 2026 |
| Cluster | Set runtime_engine to PHOTON in API | Photon is on by default for classic all-purpose, jobs compute and classic pipelines. With the Clusters or Jobs API you must set runtime_engine to PHOTON. Photon instance types use a different DBU rate. | [Databricks Photon documentation](https://docs.databricks.com/en/compute/photon.html), 10 Nov 2026 |
| Cloud | Databricks on AWS, Azure or GCP | Photon is documented as part of Databricks compute on AWS, Azure and Google Cloud. | [Databricks Photon documentation](https://docs.databricks.com/en/compute/photon.html), 10 Nov 2026 |
| Vendor | Databricks platform required | Photon runs only inside Databricks. Photon instance types consume DBUs at a different rate than the same instance without Photon, so cost depends on the DBU multiplier on the pricing page. | [Databricks pricing page](https://www.databricks.com/product/pricing), 10 Nov 2026 |

## Searched for and none found on 10 Nov 2026

- Independent third-party benchmark of Photon vs open source Spark on batch ETL (searched: docs.databricks.com/en/compute/photon.html, databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing, people.eecs.berkeley.edu/~matei/papers/2022/sigmod_photon.pdf)

## Databricks Photon side by side with each other option

- [Databricks Photon and Amazon EMR runtime for Apache Spark](/compare/databricks-photon-vs-emr-spark-runtime/)
- [Databricks Photon and Apache Auron](/compare/apache-auron-vs-databricks-photon/)
- [Databricks Photon and Apache DataFusion Comet](/compare/databricks-photon-vs-datafusion-comet/)
- [Databricks Photon and Apache Gluten with Velox](/compare/apache-gluten-velox-vs-databricks-photon/)
- [Databricks Photon and DataPelago](/compare/databricks-photon-vs-datapelago/)
- [Databricks Photon and DualBird](/compare/databricks-photon-vs-dualbird/)
- [Databricks Photon and Flarion](/compare/databricks-photon-vs-flarion/)
- [Databricks Photon and Google Cloud Lightning Engine](/compare/databricks-photon-vs-dataproc-lightning-engine/)
- [Databricks Photon and Microsoft Fabric native execution engine](/compare/databricks-photon-vs-fabric-native-execution-engine/)
- [Databricks Photon and NVIDIA cuDF plugin for Apache Spark](/compare/databricks-photon-vs-nvidia-rapids-spark/)
- [Databricks Photon and Speedata](/compare/databricks-photon-vs-speedata/)

## Sources

- Databricks Photon: docs.databricks.com/en/compute/photon.html: https://docs.databricks.com/en/compute/photon.html (read 10 Nov 2026)
- Databricks Photon: databricks.com/product/pricing: https://www.databricks.com/product/pricing (read 10 Nov 2026)
- Databricks Photon: people.eecs.berkeley.edu/~matei/papers/2022/sigmod_photon.pdf: https://people.eecs.berkeley.edu/~matei/papers/2022/sigmod_photon.pdf (read 10 Nov 2026)
- Databricks Photon: databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing: https://www.databricks.com/blog/2021/11/02/databricks-sets-official-data-warehousing-performance-record.html (read 10 Nov 2026)

Last reviewed 10 Nov 2026. Canonical: https://sparkaccelerationcompare.com/options/databricks-photon/
