# Skew

Glossary, read 10 Nov 2026

**The short answer.** Skew is an uneven spread of data across partitions, so a few tasks do most of the work while others finish early. Spark AQE treats a partition as skewed when it is larger than 256 MB and larger than 5.0 times the median partition size, and then splits it.

A skewed stage runs as long as its slowest task, so the cluster sits idle while one executor finishes. Raising the cluster size does not fix it.

DualBird says skew costs it less time because few tasks run at once on its hardware. That is a vendor claim. See [AQE](/glossary/adaptive-query-execution/) for Spark's built-in handling.

## A sourced example

The two defaults that define a skewed partition are spark.sql.adaptive.skewJoin.skewedPartitionThresholdInBytes = 256MB and spark.sql.adaptive.skewJoin.skewedPartitionFactor = 5.0; both conditions must hold.

## Sources

- Apache Spark configuration reference: adaptive skew join: https://spark.apache.org/docs/latest/configuration.html (read 10 Nov 2026)

Last reviewed 10 Nov 2026. Canonical: https://sparkaccelerationcompare.com/glossary/skew/
