Glossary, read 10 Nov 2026
Sort-merge join
Sort and shuffle are the work that native-engine and hardware vendors say they take over. The Databricks post below shows JVM code generation helping hash join far more than sort-merge join.
The MERGE join hint asks Spark for this strategy. See shuffle and spill for the costs around it.
A sourced example
In the Databricks engineering post on Spark 2.0, whole-stage code generation cut hash join cost per row from 115 ns to 4.0 ns, but sort-merge join only moved from 750 ns to 700 ns.
Sources
- Databricks blog: Apache Spark as a Compiler (May 23, 2016), read 10 Nov 2026
Last reviewed 10 Nov 2026.