Skip to content
Spark Acceleration Compare

Glossary, read 10 Nov 2026

Columnar batch

All termsOpen the Ledger

Native accelerators hand data between Spark and C++ in columnar batches. When an operator falls back to Spark, a conversion between columnar batches and rows is needed, and that conversion has a cost.

The class is marked DeveloperApi, so its shape can change between Spark releases. That is one reason plugin vendors list supported Spark versions.

A sourced example

Spark's SparkSessionExtensions has an injectColumnar method, documented in the Spark 4.3.0 API, that injects a rule to override columnar execution on an executor. Plugins hook in this way without changing job code.

Sources

  1. Apache Spark 4.3.0 API: ColumnarBatch, read 10 Nov 2026

Last reviewed 10 Nov 2026.