News, 6 Oct 2026
Apache DataFusion Comet 1.1.0 released: 416 commits from 41 contributors
Apache DataFusion Comet 1.1.0 was published on GitHub on October 6, 2026. The changelog says the release consists of 416 commits from 41 contributors. The previous release, 1.0.0, was published on August 7, 2026.
Much of the fixed-bugs list concerns native Iceberg writes: partition path escaping, evolved partition specs, cleanup of data files when a write job fails, and fallbacks to Spark for gs:// writes through HadoopFileIO. Enhancements include native scans with unprojected Spark 4 VARIANT columns and exposed native aggregate spill and memory metrics.
Comet is a plugin that moves Spark operators to a native DataFusion engine. A team writing Iceberg tables can read the fallback reasons in the changelog, since several entries add a decline or fallback instead of a native path.
Sources
- Apache DataFusion Comet 1.1.0 release, read 10 Nov 2026
Last reviewed 10 Nov 2026.