Glossary, read 10 Nov 2026
Broadcast hash join
Because no shuffle is needed for the big side, this usually costs less than a shuffled join. It fails when the small side is not small, since every executor must hold a full copy in memory.
You can force it with the BROADCAST join hint. AQE can also pick it at runtime when a table turns out smaller than the planner estimated.
A sourced example
With the default 10 MB threshold, a 40 MB dimension table is not broadcast automatically. Raising spark.sql.autoBroadcastJoinThreshold above 41943040 bytes, or adding a BROADCAST hint, changes the plan without touching the join logic.
Sources
- Apache Spark documentation: SQL performance tuning, join strategy, read 10 Nov 2026
Last reviewed 10 Nov 2026.