Glossary, read 10 Nov 2026
Apache Arrow
For Spark acceleration, Arrow matters in two places: it is the in-memory format of DataFusion-based engines such as Comet and Flarion, and it is a common exchange format between the JVM and native code.
Arrow is a format and a set of libraries, not a query engine. See DataFusion.
A sourced example
The Arrow columnar format specification reads Version 1.5 in the documentation for Arrow v26.0.1, and describes buffers that are relocatable without pointer swizzling, which allows true zero-copy access in shared memory.
Sources
- Apache Arrow home page, read 10 Nov 2026
Last reviewed 10 Nov 2026.