Option profile, read 10 Nov 2026
DualBird, FPGA Spark plugin on AWS F2: the published facts
DualBird in the LedgerCompare with another option
- Kind
- FPGA Spark plugin on AWS F2
- Website
- dualbird.io
- Name checked
- Site dualbird.io is live under the name DualBird (written 'Dualbird' in the footer). dualbird.net serves the same site. No rename or acquisition found.
- Read
- 10 Nov 2026
What it does well
- DualBird publishes a worked example: a sort-based Iceberg compaction benchmark on 100 GB, with the dataset shape (about 370 million rows, 64 columns, ZSTD level 3) and two baselines (vanilla Spark and an unnamed C++ accelerated Spark).
- DualBird says onboarding is an instance type change to F2 plus its Spark plugin, and that Spark still handles planning, scheduling and fault tolerance.
Where it is limited
- DualBird runs on AWS F2 instances only, so it is not an option on Azure, Google Cloud or a Databricks-managed cluster, and every benchmark published for it so far is its own. F2 is listed in eight AWS regions (not, for example, us-east-2 or eu-west-1), the method for its compaction benchmark is behind a sign-up form, and no price for the plugin is published.
- A DualBird engineer states that workloads dominated by Python UDFs or unsupported operators fall back to the CPU and do not see the same benefit yet.
Published speed results
| Fact | Source type | Source, read |
|---|---|---|
| The home page body text states the headline claim as 10x-30x faster data processing with 50%-90% lower costs and no changes required. The same wording appears in the page's JSON-LD organization description and in the April 28, 2026 blog post. | vendor | dualbird.io, 10 Nov 2026 |
| The raw HTML of the home page has a different range in its meta description and og:description (and twitter:description): 10x-100x faster. This is the meta tag, not body text. The February 5, 2026 funding blog post also says 10-100x faster and 50-90% cost savings. The body text of the home and product pages says 10x-30x, so the two ranges differ by site location. | vendor | dualbird.io, 10 Nov 2026 |
| The product page repeats the 10x-30x end-to-end figure labeled 'Instance for instance' and 50%-90% cost reduction labeled 'Workload for workload'. The meta description of the product page is only 'Plug-and-play Spark acceleration.' | vendor | dualbird.io/product, 10 Nov 2026 |
| Home and product pages show a '110GB Enrichment Pipeline (JOIN Denormalization)' benchmark: 50%-85% lower EC2 cost with 6x-18x higher performance ceiling. The pages give no hardware, baseline, dates or method, and no link to a write-up was found. | vendor | dualbird.io, 10 Nov 2026 |
| Sort-based Iceberg compaction on 100 GB, compared with vanilla Spark and with an unnamed 'C++ accelerated Spark' (unnamed) with tuned EBS, memory and parallelism at each cluster size. Dataset is synthetic: about 370 million rows, 64 mixed-type columns, ZSTD level 3. Results: roughly 12-20x faster single-task execution, 55-85% lower EC2 cost, stable cost across scaling, about 6x higher practical performance ceiling. Cost per terabyte compacted is stated as about $2/TB for DualBird versus about $6/TB rising past $13/TB for CPU clusters. Part of the saving is attributed to F2 local NVMe replacing EBS volumes. The home page shows 'X15-X20' single-task speedup for the same benchmark, while the June 11, 2026 blog and the white paper landing page say 12-20x. The two do not match. | vendor | dualbird.io/resources/blog/iceberg-compaction-benchmark-faster-spark-low, 10 Nov 2026 |
| The 'Single Task Performance' home-page tile says X15-X20 speedup for the same cluster size while reducing cost by over 50%. The blog describes the single-task comparison as against vanilla Spark, and the April 28 post as against 'a high-end C++ columnar engine running on a single CPU core'. The baseline wording is therefore not consistent across pages. | vendor | dualbird.io, 10 Nov 2026 |
Published cost results and prices
| Fact | Source type | Source, read |
|---|---|---|
| No pricing, price list or marketplace listing was found on the site. Cost claims are only percentages (50%-90% lower, 55%-85% lower EC2) and the about $2/TB versus $6-13/TB compaction figure. The pricing model for the plugin itself is not stated, so users cannot tell whether F2 instance price or license fee is included in the claimed savings. | vendor | dualbird.io/resources/blog/iceberg-compaction-benchmark-faster-spark-low, 10 Nov 2026 |
Code changes
| Fact | Source type | Source, read |
|---|---|---|
| Onboarding is two changes: switch the EC2 instance type to F2 and add the DualBird Spark plugin. The page shows three steps: change instance type, use our Spark plugin, see the results. The about page says 'No infrastructure changes. No code changes.' The compaction blog says Spark still handles planning, scheduling and fault tolerance and no pipeline rewrite or platform migration is needed. | vendor | dualbird.io, 10 Nov 2026 |
| A DualBird engineer states the FPGA path accelerates a defined set of operators (sort, join, aggregation and others). Workloads dominated by Python UDFs or unsupported operators fall back to CPU and do not see the same benefit yet. Coverage is described as expanding. | vendor | dualbird.io/resources/blog/a-simpler-spark, 10 Nov 2026 |
Tuning
| Fact | Source type | Source, read |
|---|---|---|
| DualBird claims tens of Spark settings (executor sizing, CPU-memory ratios, parallelism) become irrelevant, disk spills effectively disappear and data skew stops causing spills, because only a few tasks run at once on the FPGA. The product page says the majority of common Spark performance configurations do not exist when using the solution. Cluster sizing reduces to the number of F2 nodes. These are vendor claims, not independently tested. Part 2 of the series (Sep 1, 2026) says skew still costs time, but less, and that it does not need repartitioning or salting. | vendor | dualbird.io/product, 10 Nov 2026 |
Spark versions, platforms and table formats
| Fact | Source type | Source, read |
|---|---|---|
| The home page says the plugin is compatible with Apache Spark, Amazon EMR and Amazon EKS. It lists 'Optimized out of the box', 'Migration-free' and 'No more performance tuning and troubleshooting'. No Spark version numbers, Databricks support or Iceberg/Delta/Hudi support list are stated on the home, product, about or resources pages. Iceberg appears only in the compaction benchmark and in the meta description of the Dec 1, 2025 demo post ('Accelerate Apache Spark and Apache Iceberg'). | vendor | dualbird.io, 10 Nov 2026 |
Where it runs
| Fact | Source type | Source, read |
|---|---|---|
| DualBird needs AWS EC2 F2 instances. AWS describes F2 as second-generation FPGA instances with up to 8 AMD Virtex UltraScale+ HBM VU47P FPGAs, 16 GiB HBM per FPGA, 3rd-gen AMD EPYC (Milan) CPUs up to 192 vCPU, up to 2 TiB memory and up to 7.6 TiB NVMe. Sizes: f2.6xlarge (1 FPGA, 24 vCPU, 256 GiB), f2.12xlarge (2 FPGAs, 48 vCPU, 512 GiB), f2.48xlarge (8 FPGAs, 192 vCPU, 2,048 GiB). | cloud provider docs | aws.amazon.com/ec2/instance-types/f2, 10 Nov 2026 |
| The AWS 'instance types by Region' doc lists F2 in eight regions: us-east-1 (N. Virginia), us-west-2 (Oregon), ap-northeast-1 (Tokyo), ap-northeast-2 (Seoul), ap-southeast-2 (Sydney), ca-central-1 (Canada Central), eu-central-1 (Frankfurt) and eu-west-2 (London). F2 is not listed in other regions on that page (for example us-east-2, eu-west-1). DualBird is AWS-only: no other cloud is mentioned. | cloud provider docs | docs.aws.amazon.com/ec2/latest/instancetypes/ec2-instance-regions.html, 10 Nov 2026 |
| The product page says deployment runs on the customer's own servers in their AWS environment and 'Everything stays under your control'. | vendor | dualbird.io/product, 10 Nov 2026 |
How open its benchmarks are
| Fact | Source type | Source, read |
|---|---|---|
| The white paper (dated July 1, 2026) has a landing page that restates the results and says methodology, system architecture and detailed analysis are in a download. The full document is gated behind a form and was not readable. The blog gives dataset shape and baselines but not instance counts, Spark version, configs or scripts. No public repo was found (github.com/dualbird returns 404). | vendor | dualbird.io/resources/blog/spark-iceberg-compaction-benchmark-whitepaper, 10 Nov 2026 |
Company and breadth
| Fact | Source type | Source, read |
|---|---|---|
| DualBird's own blog (Feb 5, 2026) announces a $25M raise led by Lightspeed Venture Partners with Angular Ventures, Uncork Capital and Bessemer Venture Partners. It says general availability was planned for early 2026 and that early deployments with design partners showed hours-to-minutes gains. The funding is confirmed by the company itself only. Lightspeed's page returned HTTP 403 and no press article was reachable. | vendor | dualbird.io/resources/blog/dualbird-raises-25m, 10 Nov 2026 |
Profile
| Fact | Source type | Source, read |
|---|---|---|
| Use cases on the home page: AI data infrastructure (feature engineering and AI data prep), big data pipelines, and accelerating data analytics (fresher data for dashboards). The Iceberg compaction benchmark is the one worked example with published method. | vendor | dualbird.io, 10 Nov 2026 |
| About page: founded and led by semiconductor and distributed data systems veterans; positions FPGA-based acceleration as a drop-in Spark plugin on standard AWS instances. Blog posts date from Dec 1, 2025 to Sep 1, 2026. Footer copyright reads 2025. Contact: contact@dualbird.io. | vendor | dualbird.io/about, 10 Nov 2026 |
Ledger entries for DualBird
| Published | Option | Test | Result as published | Ran by | Method published |
|---|---|---|---|---|---|
| 2026-06-11 | DualBird | DualBird sort-based Iceberg compaction, 100 GB | About 12x to 20x faster task execution against vanilla Spark and an unnamed C++ accelerated Spark (DualBird's wording; no absolute times published) | DualBird (its maker) | Behind a sign-up form (white paper dated 2026-07-01); no public repository found |
| Not stated | DualBird | DualBird 110 GB enrichment pipeline (join denormalization) | DualBird's wording: '6x to 18x higher performance ceiling' on a 110 GB enrichment pipeline; baseline, hardware and absolute times not stated | DualBird (its maker) | No |
| Not stated | DualBird | DualBird single task performance tile | DualBird's wording: 'X15-X20 speedup for the same cluster size'; baseline not stated on the tile (the compaction post names vanilla Spark and an unnamed C++ accelerated Spark) | DualBird (its maker) | No |
Change Budget row
| Column | What changes | Detail | Source, read |
|---|---|---|---|
| Code | No code change stated | DualBird's about page says 'No infrastructure changes. No code changes.' | DualBird about page, 10 Nov 2026 |
| Cluster | Instance type change to F2 | DualBird's onboarding is two changes: switch the EC2 instance type to F2 and add the DualBird Spark plugin. Cluster sizing then reduces to the number of F2 nodes, per DualBird. | DualBird product page, 10 Nov 2026 |
| Cloud | AWS only, F2 in eight regions | F2 is listed in us-east-1, us-west-2, ap-northeast-1, ap-northeast-2, ap-southeast-2, ca-central-1, eu-central-1 and eu-west-2, and not, for example, in us-east-2 or eu-west-1. DualBird mentions no other cloud. | AWS EC2 instance types by Region, 10 Nov 2026 |
| Vendor | Plugin contract; no price published | No pricing, price list or marketplace listing was found on DualBird's site, and the pricing model for the plugin is not stated. | DualBird Iceberg compaction benchmark post, 10 Nov 2026 |
Searched for and none found on 10 Nov 2026
- Third-party (non-DualBird) benchmark or review of DualBird by another party (searched: dualbird.io/resources, github.com/dualbird, lsvp.com/dualbird)
- Supported Spark versions, Databricks support, table format support list (searched: dualbird.io, dualbird.io/product, dualbird.io/about)
- Published price or pricing model for the DualBird plugin (searched: dualbird.io, dualbird.io/product, aws.amazon.com/marketplace/search/results?searchTerms=dualbird)
- Named customers (only unnamed design partners) and press coverage of the funding round (searched: dualbird.io, dualbird.io/resources/blog/dualbird-raises-25m, dualbird.io/team)
DualBird side by side with each other option
- DualBird and Amazon EMR runtime for Apache Spark
- DualBird and Apache Auron
- DualBird and Apache DataFusion Comet
- DualBird and Apache Gluten with Velox
- DualBird and Databricks Photon
- DualBird and DataPelago
- DualBird and Flarion
- DualBird and Google Cloud Lightning Engine
- DualBird and Microsoft Fabric native execution engine
- DualBird and NVIDIA cuDF plugin for Apache Spark
- DualBird and Speedata
Sources
- DualBird: dualbird.io, read 10 Nov 2026
- DualBird: dualbird.io/product, read 10 Nov 2026
- DualBird: dualbird.io/resources/blog/a-simpler-spark, read 10 Nov 2026
- DualBird: dualbird.io/resources/blog/iceberg-compaction-benchmark-faster-spark-low, read 10 Nov 2026
- DualBird: dualbird.io/resources/blog/spark-iceberg-compaction-benchmark-whitepaper, read 10 Nov 2026
- DualBird: aws.amazon.com/ec2/instance-types/f2, read 10 Nov 2026
- DualBird: docs.aws.amazon.com/ec2/latest/instancetypes/ec2-instance-regions.html, read 10 Nov 2026
- DualBird: dualbird.io/resources/blog/dualbird-raises-25m, read 10 Nov 2026
- DualBird: dualbird.io/about, read 10 Nov 2026
Last reviewed 10 Nov 2026.