Skip to content
Spark Acceleration Compare

Glossary, read 10 Nov 2026

Apache Arrow

All termsOpen the Ledger

For Spark acceleration, Arrow matters in two places: it is the in-memory format of DataFusion-based engines such as Comet and Flarion, and it is a common exchange format between the JVM and native code.

Arrow is a format and a set of libraries, not a query engine. See DataFusion.

A sourced example

The Arrow columnar format specification reads Version 1.5 in the documentation for Arrow v26.0.1, and describes buffers that are relocatable without pointer swizzling, which allows true zero-copy access in shared memory.

Sources

  1. Apache Arrow home page, read 10 Nov 2026

Last reviewed 10 Nov 2026.