Skip to content
Spark Acceleration Compare

Glossary, read 10 Nov 2026

Tungsten

All termsOpen the Ledger

The Tungsten post argued that Spark workloads were increasingly bound by CPU and memory use rather than disk or network. That is the same argument native-engine and hardware accelerators make today, now applied below the JVM.

Tungsten's binary-processing idea is why Spark has an off-heap memory setting. See off-heap memory.

A sourced example

The post says a hash table working directly on binary data with memory managed by Spark would first appear in Spark 1.4, used for DataFrame and SQL aggregations, with sort and join structures planned for Spark 1.5.

Sources

  1. Databricks blog: Project Tungsten (April 28, 2015), read 10 Nov 2026

Last reviewed 10 Nov 2026.