<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0"><channel><title>Spark Acceleration Compare</title><link>https://sparkaccelerationcompare.com/</link><description>Twelve ways to speed up Spark without rewriting jobs, with a Ledger of published benchmarks and a Change Budget of what each makes a team change.</description><lastBuildDate>Tue, 10 Nov 2026 00:00:00 GMT</lastBuildDate>
<item><title>Where a Spark job spends its time: scan to JVM</title><link>https://sparkaccelerationcompare.com/guides/where-spark-time-goes/</link><guid>https://sparkaccelerationcompare.com/guides/where-spark-time-goes/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Where Spark time goes: scan, shuffle, sort, join, spill, serialization and the JVM, with figures from the Berkeley NSDI 2015 study and the Apache Spark documentation.</description></item>
<item><title>What &quot;no code change&quot; means for Spark acceleration</title><link>https://sparkaccelerationcompare.com/guides/what-no-code-change-means/</link><guid>https://sparkaccelerationcompare.com/guides/what-no-code-change-means/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>What no code change means for Spark acceleration: SQL and DataFrame versus RDD and UDF code, fallback, config flags and instance changes, per option.</description></item>
<item><title>How to read a vendor Spark benchmark: seven checks</title><link>https://sparkaccelerationcompare.com/guides/reading-a-vendor-benchmark/</link><guid>https://sparkaccelerationcompare.com/guides/reading-a-vendor-benchmark/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Seven checks for a Spark acceleration benchmark: who ran it, workload, scale factor, hardware, baseline Spark version, cost basis and published method.</description></item>
<item><title>GPU, FPGA and custom silicon for Spark in plain words</title><link>https://sparkaccelerationcompare.com/guides/hardware-acceleration-plain-words/</link><guid>https://sparkaccelerationcompare.com/guides/hardware-acceleration-plain-words/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>What FPGA, GPU and custom-silicon accelerators do for Apache Spark, with DualBird on AWS F2, NVIDIA cuDF and Speedata C200 as examples, plus AWS facts.</description></item>
<item><title>Spark performance tuning: what to do when it is not enough</title><link>https://sparkaccelerationcompare.com/guides/when-tuning-is-cheaper/</link><guid>https://sparkaccelerationcompare.com/guides/when-tuning-is-cheaper/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Spark performance tuning checklist (AQE, shuffle partitions, broadcast joins, file sizes, skew) and how to tell when tuning is not enough.</description></item>
<item><title>Native Spark engines: Auron, DataFusion, Photon, Velox</title><link>https://sparkaccelerationcompare.com/guides/native-engines-explained/</link><guid>https://sparkaccelerationcompare.com/guides/native-engines-explained/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>What vectorized native Spark engines do (Auron, DataFusion, Photon, Velox): columnar execution, operator coverage, fallback, Spark versions and where each runs.</description></item>
<item><title>GPU vs FPGA for Spark: the published facts on each</title><link>https://sparkaccelerationcompare.com/guides/gpu-vs-fpga-for-spark/</link><guid>https://sparkaccelerationcompare.com/guides/gpu-vs-fpga-for-spark/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>GPU versus FPGA for Apache Spark: what DualBird and NVIDIA have each published about speed, cost, hardware, operators and availability, side by side with sources.</description></item>
<item><title>Spark acceleration options on Amazon EMR and EKS</title><link>https://sparkaccelerationcompare.com/guides/spark-acceleration-on-emr-and-eks/</link><guid>https://sparkaccelerationcompare.com/guides/spark-acceleration-on-emr-and-eks/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Which Spark accelerators run on Amazon EMR and EKS and what each needs: instance families, plugins, EMR release labels, Spark versions and billing.</description></item>
<item><title>Operator coverage and fallback: checking what an accelerator covers</title><link>https://sparkaccelerationcompare.com/guides/operator-coverage-and-fallback/</link><guid>https://sparkaccelerationcompare.com/guides/operator-coverage-and-fallback/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>How to check which Spark operators an accelerator covers and what happens on fallback, using each project's supported-operator lists, explain output and the Spark UI.</description></item>
<item><title>How to run a fair two-week Spark accelerator trial</title><link>https://sparkaccelerationcompare.com/guides/trialing-an-accelerator/</link><guid>https://sparkaccelerationcompare.com/guides/trialing-an-accelerator/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>A two-week plan to trial a Spark accelerator on your own jobs: baseline, same data, same cluster cost, cost per job, event logs and the Spark UI, with sources.</description></item>
<item><title>Apache Spark 4.3.0 released with stateful Real-Time Mode and SCD Type 2</title><link>https://sparkaccelerationcompare.com/news/spark-4-3-0-released/</link><guid>https://sparkaccelerationcompare.com/news/spark-4-3-0-released/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Apache Spark 4.3.0 was announced on October 30, 2026, the fourth release of the 4.x line.</description></item>
<item><title>Apache Spark 4.2.1, 4.1.4 and 4.0.5 maintenance releases announced</title><link>https://sparkaccelerationcompare.com/news/spark-maintenance-releases-oct-2026/</link><guid>https://sparkaccelerationcompare.com/news/spark-maintenance-releases-oct-2026/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Apache Spark announced three maintenance releases on October 27, 2026: 4.2.1, 4.1.4 and 4.0.5.</description></item>
<item><title>Apache Gluten 1.7.0 released with Spark 4.x test coverage and Delta 4 native write</title><link>https://sparkaccelerationcompare.com/news/gluten-1-7-0-released/</link><guid>https://sparkaccelerationcompare.com/news/gluten-1-7-0-released/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Apache Gluten published release 1.7.0 on August 26, 2026, after three release candidates dated August 10, 17 and 21.</description></item>
<item><title>Apache DataFusion Comet 1.1.0 released: 416 commits from 41 contributors</title><link>https://sparkaccelerationcompare.com/news/comet-1-1-0-released/</link><guid>https://sparkaccelerationcompare.com/news/comet-1-1-0-released/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Apache DataFusion Comet 1.1.0 was published on October 6, 2026.</description></item>
<item><title>Apache DataFusion Comet 1.2.0 released: 399 commits from 40 contributors</title><link>https://sparkaccelerationcompare.com/news/comet-1-2-0-released/</link><guid>https://sparkaccelerationcompare.com/news/comet-1-2-0-released/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Apache DataFusion Comet 1.2.0 was published on November 3, 2026, four weeks after 1.1.0.</description></item>
<item><title>NVIDIA cuDF plugin for Apache Spark 26.10.0 released, adds Spark 4.2.0 support</title><link>https://sparkaccelerationcompare.com/news/nvidia-cudf-plugin-26-10-0/</link><guid>https://sparkaccelerationcompare.com/news/nvidia-cudf-plugin-26-10-0/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>NVIDIA published release v26.10.0 of its cuDF plugin for Apache Spark on November 5, 2026.</description></item>
<item><title>Amazon EMR introduces Long Term Support, starting with emr-spark-8.1.0 on Spark 4.1</title><link>https://sparkaccelerationcompare.com/news/emr-spark-8-1-0-lts/</link><guid>https://sparkaccelerationcompare.com/news/emr-spark-8-1-0-lts/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Amazon EMR announced Long Term Support releases on September 22, 2026, starting with emr-spark-8.1.0 and Apache Spark 4.1.</description></item>
<item><title>Amazon EMR 7.14 is available with Spark 3.5.8 and Iceberg 1.10.1</title><link>https://sparkaccelerationcompare.com/news/emr-7-14-available/</link><guid>https://sparkaccelerationcompare.com/news/emr-7-14-available/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>AWS announced Amazon EMR 7.14 on September 22, 2026.</description></item>
<item><title>Amazon EMR on EKS cuts the EMR charge by 30 percent</title><link>https://sparkaccelerationcompare.com/news/emr-eks-charge-cut-30-percent/</link><guid>https://sparkaccelerationcompare.com/news/emr-eks-charge-cut-30-percent/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>AWS announced on October 23, 2026 a 30 percent reduction in the EMR charge added to EKS when running EMR on EKS.</description></item>
<item><title>EMR Serverless raises the Spark shuffle limit from 200 GB to 1 TB per job</title><link>https://sparkaccelerationcompare.com/news/emr-serverless-terabyte-shuffle/</link><guid>https://sparkaccelerationcompare.com/news/emr-serverless-terabyte-shuffle/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>AWS announced on October 1, 2026 that Amazon EMR Serverless supports up to 1 TB of shuffle per job, raising the previous 200 GB limit.</description></item>
<item><title>Amazon EMR on EKS adds interactive Spark sessions with Spark Connect</title><link>https://sparkaccelerationcompare.com/news/emr-eks-spark-connect-interactive/</link><guid>https://sparkaccelerationcompare.com/news/emr-eks-spark-connect-interactive/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>AWS announced on September 24, 2026 that Amazon EMR on EKS supports interactive Apache Spark sessions through Spark Connect.</description></item>
<item><title>Google Lightning Engine runs on Arm with Axion C4A for Dataproc 2.3 clusters</title><link>https://sparkaccelerationcompare.com/news/lightning-engine-arm-axion/</link><guid>https://sparkaccelerationcompare.com/news/lightning-engine-arm-axion/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Google's Dataproc release notes of September 1, 2026 say Lightning Engine with Native Query Execution is supported on Arm for image version 2.3 clusters (2.3-ubuntu2</description></item>
<item><title>Google Lightning Engine reaches Dataproc 3.0 cluster images from 3.0.2</title><link>https://sparkaccelerationcompare.com/news/lightning-engine-3-0-images/</link><guid>https://sparkaccelerationcompare.com/news/lightning-engine-3-0-images/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Google's release notes dated September 23, 2026 say Lightning Engine is supported in Dataproc 3.0 cluster images from subminor version 3.0.2 (3.0.2-debian13 and 3.0.</description></item>
<item><title>DualBird blog Part 2: why data skew costs less on its FPGA architecture</title><link>https://sparkaccelerationcompare.com/news/dualbird-skew-part-2/</link><guid>https://sparkaccelerationcompare.com/news/dualbird-skew-part-2/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>DualBird published Part 2 of its Faster Spark series on September 1, 2026, written by its chief architect and co-founder.</description></item>
<item><title>Flarion blog: the hard part of a Spark upgrade is proving the output did not change</title><link>https://sparkaccelerationcompare.com/news/flarion-spark-upgrade-validation/</link><guid>https://sparkaccelerationcompare.com/news/flarion-spark-upgrade-validation/</guid><pubDate>Tue, 10 Nov 2026 00:00:00 GMT</pubDate><description>Flarion published a blog post on August 18, 2026 arguing that validation, not code rewriting, is the main obstacle to Spark version upgrades.</description></item>
</channel></rss>
