Skip to content
Spark Acceleration Compare

News, 30 Oct 2026

Apache Spark 4.3.0 released with stateful Real-Time Mode and SCD Type 2

All newsOpen the Ledger

Apache Spark 4.3.0 is the fourth release of the Spark 4.x line, per the project's release notes. The notes say it addressed over 1,100 Jira tickets with contributions from more than 210 individuals. It marks the start of a quarterly feature-release cadence.

The headline items are stateful queries in Structured Streaming Real-Time Mode (streaming aggregation, dropDuplicates and transformWithState, with end-to-end latency the notes put on the order of 100 milliseconds), SCD Type 2 in Spark Declarative Pipelines Auto CDC, and opt-in settings that cut fixed overhead on small queries. SQL adds JSON_TABLE, ANSI UNNEST and ASOF JOIN.

For a team that accelerates Spark with a plugin or a native engine, the practical check is the plugin's supported-version list. The NVIDIA cuDF plugin page read on 2026-11-10 lists Spark up to 4.2.0, and 4.3.0 is not on that list. None found on 2026-11-10 for the other options.

Sources

  1. Apache Spark 4.3.0 release notes, read 10 Nov 2026
  2. Apache Spark news, read 10 Nov 2026

Last reviewed 10 Nov 2026.