Skip to content
Spark Acceleration Compare

Glossary, read 10 Nov 2026

Speculative execution

All termsOpen the Ledger

Speculation helps when one node is slow, and does nothing for skew, since a duplicate of an oversized task is still oversized. It also spends extra cores, which matters when you pay per vCPU-hour.

Check whether a benchmark baseline had it on. It changes elapsed time and cost without changing the job.

A sourced example

The Spark defaults are spark.speculation.multiplier=3, spark.speculation.quantile=0.9 and spark.speculation.minTaskRuntime=100ms, with a check interval of 100ms.

Sources

  1. Apache Spark configuration reference: speculation, read 10 Nov 2026

Last reviewed 10 Nov 2026.