Skip to content

Conditionally slice elements to selected index bounds before filtering wide list arrays - #9679

Open
mhk197 wants to merge 8 commits into
developfrom
mk/crop-list-filter-elements
Open

Conditionally slice elements to selected index bounds before filtering wide list arrays#9679
mhk197 wants to merge 8 commits into
developfrom
mk/crop-list-filter-elements

Conversation

@mhk197

@mhk197 mhk197 commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Summary

Avoid expanding ListArray element masks over large unselected prefixes and suffixes. For lists averaging more than 1,024 elements per sublist, filter the child slice spanning the first through last selected list instead of the complete element range.

Example

Suppose a ListArray contains eight sublists with 2,000 elements each, and the outer filter selects rows 3 and 4. The existing path expands the mask across all 16,000 child elements. This change slices elements 6,000..10,000 and expands the mask across only those 4,000 elements.

If the selected rows span the complete element range, the optimization keeps the existing full-range path.

@mhk197 mhk197 added changelog/performance A performance improvement action/bench-sql Run SQL benchmarks without Vortex Compact on this PR labels Aug 27, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 27, 2026
@codspeed-hq

codspeed-hq Bot commented Aug 27, 2026

Copy link
Copy Markdown

Merging this PR will degrade performance by 0.12%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚡ 3 improved benchmarks
❌ 4 regressed benchmarks
✅ 2150 untouched benchmarks
🆕 12 new benchmarks
⏩ 106 skipped benchmarks1
🗄️ 4 archived benchmarks run2

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation take_map[(0.1, 1.0)] 226.8 µs 262.8 µs -13.73%
Simulation take_map[(0.1, 0.5)] 151 µs 173.8 µs -13.12%
Simulation compact_sliced[(1024, 90)] 1.4 µs 1.5 µs -10.74%
Simulation compact_sliced[(2048, 90)] 1.4 µs 1.6 µs -10.34%
WallTime arrow_checked_add_u32_avx512[16384] 21.4 µs 17.7 µs +20.84%
WallTime arrow_checked_add_u32_avx2[16384] 21.4 µs 17.7 µs +20.83%
WallTime words_gather_scalar_avx2[65536] 9.4 µs 8.3 µs +13.19%
🆕 Simulation filter_list_primitive_short[AllSelected] N/A 135.8 µs N/A
🆕 Simulation filter_list_primitive_short[Clustered] N/A 145.6 µs N/A
🆕 Simulation filter_list_primitive_short[EdgeSpanning] N/A 160.3 µs N/A
🆕 Simulation filter_list_primitive_short[Prefix] N/A 147.9 µs N/A
🆕 Simulation filter_list_primitive_short[Sparse] N/A 142.5 µs N/A
🆕 Simulation filter_list_primitive_wide[AllSelected] N/A 134.8 µs N/A
🆕 Simulation filter_list_primitive_wide[Clustered] N/A 149.1 µs N/A
🆕 Simulation filter_list_primitive_wide[EdgeSpanning] N/A 898.7 µs N/A
🆕 Simulation filter_list_primitive_wide[Prefix] N/A 149.9 µs N/A
🆕 Simulation filter_list_primitive_wide[Sparse] N/A 143.5 µs N/A
🆕 Simulation filter_list_primitive_short[Repeated] N/A 246.3 µs N/A
🆕 Simulation filter_list_primitive_wide[Repeated] N/A 2 ms N/A

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.


Comparing mk/crop-list-filter-elements (784c0b3) with develop (d1a4ad6)3

Open in CodSpeed

Footnotes

  1. 106 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

  2. 4 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them.

  3. No successful run was found on develop (68d6573) during the generation of this report, so d1a4ad6 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done ff9eddd statpopgen 1 Explore Profiling Data
🟢 Done ff9eddd clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done ff9eddd fineweb 1 Explore Profiling Data
🟢 Done ff9eddd fineweb-s3 1 Explore Profiling Data
🟢 Done ff9eddd tpch-nvme-10 1 Explore Profiling Data
🟢 Done ff9eddd clickbench-nvme 1 Explore Profiling Data
🟢 Done ff9eddd tpcds-nvme 1 Explore Profiling Data
🟢 Done ff9eddd polarsignals 1 Explore Profiling Data
🟢 Done ff9eddd tpch-s3 1 Explore Profiling Data
🟢 Done ff9eddd tpch-nvme 1 Explore Profiling Data
Previous Runs (10)
Status Commit Job Attempt Link
🟢 Done 31aad16 statpopgen 1 Explore Profiling Data
🟢 Done 31aad16 clickbench-sorted-nvme 1 Explore Profiling Data
🟢 Done 31aad16 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 31aad16 fineweb 1 Explore Profiling Data
🟢 Done 31aad16 fineweb-s3 1 Explore Profiling Data
🟢 Done 31aad16 clickbench-nvme 1 Explore Profiling Data
🟢 Done 31aad16 tpcds-nvme 1 Explore Profiling Data
🟢 Done 31aad16 tpch-nvme 1 Explore Profiling Data
🟢 Done 31aad16 polarsignals 1 Explore Profiling Data
🟢 Done 31aad16 tpch-s3 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR ff9eddd4 vs base 68e2aee0
Vortex (geomean): hot 0.981x ➖ · cold 0.974x ➖


datafusion / vortex-file-compressed / ns (0.981x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 105499064 / 103020024 / +2.4% 197985476 / 198995985 / -0.5% 0.53 / 0.52 / +2.9%
polarsignals_q01/datafusion:vortex-file-compressed 156334710 / 158435548 / -1.3% 267758149 / 274060336 / -2.3% 0.58 / 0.58 / +1.0%
polarsignals_q02/datafusion:vortex-file-compressed 18133686 / 20184260 / -10.2% 🟢 82985615 / 84149613 / -1.4% 0.22 / 0.24 / -8.9%
polarsignals_q03/datafusion:vortex-file-compressed 157994524 / 158407997 / -0.3% 267766871 / 271028054 / -1.2% 0.59 / 0.58 / +1.0%
polarsignals_q04/datafusion:vortex-file-compressed 10693948 / 10433213 / +2.5% 75872747 / 73740015 / +2.9% 0.14 / 0.14 / -0.4%
polarsignals_q05/datafusion:vortex-file-compressed 13551516 / 13348108 / +1.5% 84930106 / 84286083 / +0.8% 0.16 / 0.16 / +0.8%
polarsignals_q06/datafusion:vortex-file-compressed 28498990 / 26822888 / +6.2% 98129417 / 98847305 / -0.7% 0.29 / 0.27 / +7.0%
polarsignals_q07/datafusion:vortex-file-compressed 11808159 / 12529180 / -5.8% 79260119 / 85475575 / -7.3% 0.15 / 0.15 / +1.6%
polarsignals_q08/datafusion:vortex-file-compressed 283580859 / 287477931 / -1.4% 388137496 / 396792317 / -2.2% 0.73 / 0.72 / +0.8%
polarsignals_q09/datafusion:vortex-file-compressed 12877366 / 14457190 / -10.9% 🟢 70888317 / 81242359 / -12.7% 🟢 0.18 / 0.18 / +2.1%

No file size changes detected.

@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR ff9eddd4 vs base 68e2aee0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.6%
Engines: DataFusion No clear signal (+2.7%, low confidence) · DuckDB No clear signal (-1.4%, low confidence)
Vortex (geomean): hot 0.995x ➖ · cold 0.966x ➖
Parquet (geomean): hot 0.990x ➖ · cold 1.001x ➖
Shifts: Parquet (control) -1.0% · Median polish -0.3%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.009x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 8740756 / 8396558 / +4.1% 38340562 / 38149891 / +0.5% 0.23 / 0.22 / +3.6%
fineweb_q01/datafusion:vortex-file-compressed 29558500 / 30078092 / -1.7% 97510501 / 98572830 / -1.1% 0.30 / 0.31 / -0.7%
fineweb_q02/datafusion:vortex-file-compressed 28002856 / 27909096 / +0.3% 99258563 / 93902562 / +5.7% 0.28 / 0.30 / -5.1%
fineweb_q03/datafusion:vortex-file-compressed 43594764 / 43523188 / +0.2% 185761893 / 183630756 / +1.2% 0.23 / 0.24 / -1.0%
fineweb_q04/datafusion:vortex-file-compressed 195906740 / 208053206 / -5.8% 327373700 / 316270899 / +3.5% 0.60 / 0.66 / -9.0%
fineweb_q05/datafusion:vortex-file-compressed 150195418 / 152877902 / -1.8% 281037617 / 287864926 / -2.4% 0.53 / 0.53 / +0.6%
fineweb_q06/datafusion:vortex-file-compressed 39798026 / 40722610 / -2.3% 182932753 / 184875893 / -1.1% 0.22 / 0.22 / -1.2%
fineweb_q07/datafusion:vortex-file-compressed 38782694 / 38745922 / +0.1% 178993232 / 178462087 / +0.3% 0.22 / 0.22 / -0.2%
fineweb_q08/datafusion:vortex-file-compressed 22104774 / 18903020 / +16.9% 🔴 78194893 / 70721787 / +10.6% 🔴 0.28 / 0.27 / +5.8%
datafusion / parquet / ns (0.983x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 8419762 / 9144055 / -7.9% 51881177 / 52527663 / -1.2% 0.16 / 0.17 / -6.8%
fineweb_q01/datafusion:parquet 190422496 / 191927492 / -0.8% 285530091 / 283464716 / +0.7% 0.67 / 0.68 / -1.5%
fineweb_q02/datafusion:parquet 188553267 / 188850333 / -0.2% 281035107 / 283982387 / -1.0% 0.67 / 0.67 / +0.9%
fineweb_q03/datafusion:parquet 190389932 / 191615504 / -0.6% 282373916 / 284968430 / -0.9% 0.67 / 0.67 / +0.3%
fineweb_q04/datafusion:parquet 207740056 / 211578791 / -1.8% 304834655 / 298178525 / +2.2% 0.68 / 0.71 / -4.0%
fineweb_q05/datafusion:parquet 204407417 / 206337893 / -0.9% 299419388 / 298439145 / +0.3% 0.68 / 0.69 / -1.3%
fineweb_q06/datafusion:parquet 191034360 / 190006486 / +0.5% 280196485 / 285514115 / -1.9% 0.68 / 0.67 / +2.4%
fineweb_q07/datafusion:parquet 188236506 / 193415952 / -2.7% 280581184 / 287533321 / -2.4% 0.67 / 0.67 / -0.3%
fineweb_q08/datafusion:parquet 187321323 / 188174880 / -0.5% 283830554 / 282975508 / +0.3% 0.66 / 0.66 / -0.8%
duckdb / vortex-file-compressed / ns (0.982x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 3618211 / 4796300 / -24.6% 🟢 14900087 / 16897766 / -11.8% 🟢 0.24 / 0.28 / -14.4%
fineweb_q01/duckdb:vortex-file-compressed 35791294 / 38949370 / -8.1% 118797279 / 133548301 / -11.0% 🟢 0.30 / 0.29 / +3.3%
fineweb_q02/duckdb:vortex-file-compressed 45101298 / 43382366 / +4.0% 112405345 / 109314747 / +2.8% 0.40 / 0.40 / +1.1%
fineweb_q03/duckdb:vortex-file-compressed 66431652 / 67248672 / -1.2% 187804140 / 223301785 / -15.9% 🟢 0.35 / 0.30 / +17.5%
fineweb_q04/duckdb:vortex-file-compressed 277488106 / 270942762 / +2.4% 396640494 / 409991626 / -3.3% 0.70 / 0.66 / +5.9%
fineweb_q05/duckdb:vortex-file-compressed 222374114 / 215235934 / +3.3% 322930034 / 325783608 / -0.9% 0.69 / 0.66 / +4.2%
fineweb_q06/duckdb:vortex-file-compressed 66298768 / 66644544 / -0.5% 256482943 / 305888464 / -16.2% 🟢 0.26 / 0.22 / +18.6%
fineweb_q07/duckdb:vortex-file-compressed 64591553 / 58311776 / +10.8% 🔴 176943524 / 197150026 / -10.2% 🟢 0.37 / 0.30 / +23.4%
fineweb_q08/duckdb:vortex-file-compressed 27769686 / 27223186 / +2.0% 89390048 / 95414373 / -6.3% 0.31 / 0.29 / +8.9%
duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 34876208 / 35765564 / -2.5% 41446971 / 41592528 / -0.3% 0.84 / 0.86 / -2.1%
fineweb_q01/duckdb:parquet 74939362 / 78267628 / -4.3% 111081625 / 105496720 / +5.3% 0.67 / 0.74 / -9.1%
fineweb_q02/duckdb:parquet 78216965 / 77673092 / +0.7% 110390990 / 114421520 / -3.5% 0.71 / 0.68 / +4.4%
fineweb_q03/duckdb:parquet 206693908 / 205464268 / +0.6% 409912817 / 424259261 / -3.4% 0.50 / 0.48 / +4.1%
fineweb_q04/duckdb:parquet 230833034 / 235489252 / -2.0% 438139261 / 396184336 / +10.6% 🔴 0.53 / 0.59 / -11.4%
fineweb_q05/duckdb:parquet 204693704 / 204081086 / +0.3% 419111895 / 421979679 / -0.7% 0.49 / 0.48 / +1.0%
fineweb_q06/duckdb:parquet 142487018 / 142317422 / +0.1% 271235941 / 265585148 / +2.1% 0.53 / 0.54 / -2.0%
fineweb_q07/duckdb:parquet 147230286 / 146215506 / +0.7% 344525955 / 343833215 / +0.2% 0.43 / 0.43 / +0.5%
fineweb_q08/duckdb:parquet 38782870 / 37733796 / +2.8% 39407313 / 40816172 / -3.5% 0.98 / 0.92 / +6.5%

No file size changes detected.

@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR ff9eddd4 vs base 68e2aee0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Engines: DataFusion No clear signal (+0.1%, low confidence) · DuckDB No clear signal (-1.0%, low confidence)
Vortex (geomean): hot 0.996x ➖ · cold 1.006x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.033x ➖
Shifts: Parquet (control) +0.0% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.005x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 43795722 / 42977171 / +1.9% 101908042 / 101993491 / -0.1% 0.43 / 0.42 / +2.0%
tpch_q02/datafusion:vortex-file-compressed 24011174 / 23393345 / +2.6% 69673243 / 68884158 / +1.1% 0.34 / 0.34 / +1.5%
tpch_q03/datafusion:vortex-file-compressed 27247121 / 26923949 / +1.2% 95908447 / 95860351 / +0.1% 0.28 / 0.28 / +1.1%
tpch_q04/datafusion:vortex-file-compressed 15256491 / 15580177 / -2.1% 65106423 / 66627076 / -2.3% 0.23 / 0.23 / +0.2%
tpch_q05/datafusion:vortex-file-compressed 46760414 / 47386889 / -1.3% 124311323 / 119802148 / +3.8% 0.38 / 0.40 / -4.9%
tpch_q06/datafusion:vortex-file-compressed 7668639 / 7674968 / -0.1% 59920041 / 57617295 / +4.0% 0.13 / 0.13 / -3.9%
tpch_q07/datafusion:vortex-file-compressed 55644243 / 55582005 / +0.1% 128990045 / 125453433 / +2.8% 0.43 / 0.44 / -2.6%
tpch_q08/datafusion:vortex-file-compressed 46301834 / 45819786 / +1.1% 117335024 / 119376257 / -1.7% 0.39 / 0.38 / +2.8%
tpch_q09/datafusion:vortex-file-compressed 55321038 / 53855655 / +2.7% 134506862 / 128037300 / +5.1% 0.41 / 0.42 / -2.2%
tpch_q10/datafusion:vortex-file-compressed 27267094 / 27397630 / -0.5% 100573846 / 99585169 / +1.0% 0.27 / 0.28 / -1.5%
tpch_q11/datafusion:vortex-file-compressed 17948921 / 17891546 / +0.3% 66653110 / 64078445 / +4.0% 0.27 / 0.28 / -3.6%
tpch_q12/datafusion:vortex-file-compressed 23821015 / 23706731 / +0.5% 74958378 / 77154381 / -2.8% 0.32 / 0.31 / +3.4%
tpch_q13/datafusion:vortex-file-compressed 23801289 / 23284750 / +2.2% 79215466 / 76112311 / +4.1% 0.30 / 0.31 / -1.8%
tpch_q14/datafusion:vortex-file-compressed 16607085 / 16344588 / +1.6% 74947945 / 76781532 / -2.4% 0.22 / 0.21 / +4.1%
tpch_q15/datafusion:vortex-file-compressed 20458721 / 20889571 / -2.1% 81127207 / 81070473 / +0.1% 0.25 / 0.26 / -2.1%
tpch_q16/datafusion:vortex-file-compressed 21443087 / 22493625 / -4.7% 76003935 / 76103955 / -0.1% 0.28 / 0.30 / -4.5%
tpch_q17/datafusion:vortex-file-compressed 56777396 / 54694653 / +3.8% 124575297 / 125512732 / -0.7% 0.46 / 0.44 / +4.6%
tpch_q18/datafusion:vortex-file-compressed 63024841 / 63971051 / -1.5% 121282672 / 123308825 / -1.6% 0.52 / 0.52 / +0.2%
tpch_q19/datafusion:vortex-file-compressed 15505624 / 15986877 / -3.0% 72929768 / 73216861 / -0.4% 0.21 / 0.22 / -2.6%
tpch_q20/datafusion:vortex-file-compressed 26668248 / 26821563 / -0.6% 87676669 / 86393911 / +1.5% 0.30 / 0.31 / -2.0%
tpch_q21/datafusion:vortex-file-compressed 59651381 / 60201671 / -0.9% 136222810 / 137403062 / -0.9% 0.44 / 0.44 / -0.1%
tpch_q22/datafusion:vortex-file-compressed 14651776 / 13311134 / +10.1% 🔴 61318352 / 63610542 / -3.6% 0.24 / 0.21 / +14.2%
datafusion / parquet / ns (1.003x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 110341370 / 110223052 / +0.1% 238203288 / 144849953 / +64.4% 🔴 0.46 / 0.76 / -39.1%
tpch_q02/datafusion:parquet 69748417 / 69081096 / +1.0% 119156040 / 117268822 / +1.6% 0.59 / 0.59 / -0.6%
tpch_q03/datafusion:parquet 86537540 / 90446979 / -4.3% 153464106 / 144900024 / +5.9% 0.56 / 0.62 / -9.7%
tpch_q04/datafusion:parquet 51223939 / 50444052 / +1.5% 99448713 / 105697077 / -5.9% 0.52 / 0.48 / +7.9%
tpch_q05/datafusion:parquet 99975489 / 100651514 / -0.7% 187083176 / 167902983 / +11.4% 🔴 0.53 / 0.60 / -10.9%
tpch_q06/datafusion:parquet 49541752 / 42194441 / +17.4% 🔴 97030943 / 80842656 / +20.0% 🔴 0.51 / 0.52 / -2.2%
tpch_q07/datafusion:parquet 114929596 / 110313361 / +4.2% 197736483 / 190440745 / +3.8% 0.58 / 0.58 / +0.3%
tpch_q08/datafusion:parquet 104516554 / 105700492 / -1.1% 171492749 / 174234444 / -1.6% 0.61 / 0.61 / +0.5%
tpch_q09/datafusion:parquet 131397752 / 132772541 / -1.0% 216139209 / 213544785 / +1.2% 0.61 / 0.62 / -2.2%
tpch_q10/datafusion:parquet 114875136 / 115732373 / -0.7% 197847145 / 184236371 / +7.4% 0.58 / 0.63 / -7.6%
tpch_q11/datafusion:parquet 49675083 / 49926694 / -0.5% 107570207 / 105850219 / +1.6% 0.46 / 0.47 / -2.1%
tpch_q12/datafusion:parquet 99180484 / 96269384 / +3.0% 147563812 / 155594098 / -5.2% 0.67 / 0.62 / +8.6%
tpch_q13/datafusion:parquet 212433040 / 210765637 / +0.8% 272790191 / 266740846 / +2.3% 0.78 / 0.79 / -1.4%
tpch_q14/datafusion:parquet 48496473 / 54350802 / -10.8% 🟢 106958771 / 111475683 / -4.1% 0.45 / 0.49 / -7.0%
tpch_q15/datafusion:parquet 66773314 / 66467134 / +0.5% 122451712 / 119796681 / +2.2% 0.55 / 0.55 / -1.7%
tpch_q16/datafusion:parquet 51782227 / 51998157 / -0.4% 103603427 / 104858533 / -1.2% 0.50 / 0.50 / +0.8%
tpch_q17/datafusion:parquet 149858900 / 151878850 / -1.3% 194956149 / 180569537 / +8.0% 0.77 / 0.84 / -8.6%
tpch_q18/datafusion:parquet 162528313 / 163162632 / -0.4% 223715570 / 214968257 / +4.1% 0.73 / 0.76 / -4.3%
tpch_q19/datafusion:parquet 79878026 / 76322825 / +4.7% 143769825 / 128270145 / +12.1% 🔴 0.56 / 0.60 / -6.6%
tpch_q20/datafusion:parquet 73545979 / 73345419 / +0.3% 143921857 / 137117672 / +5.0% 0.51 / 0.53 / -4.5%
tpch_q21/datafusion:parquet 129740771 / 134320793 / -3.4% 202598545 / 209120408 / -3.1% 0.64 / 0.64 / -0.3%
tpch_q22/datafusion:parquet 56110765 / 55495726 / +1.1% 102795968 / 100044492 / +2.8% 0.55 / 0.55 / -1.6%
duckdb / vortex-file-compressed / ns (0.987x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 23417751 / 21949626 / +6.7% 63813026 / 65072143 / -1.9% 0.37 / 0.34 / +8.8%
tpch_q02/duckdb:vortex-file-compressed 29920346 / 30615633 / -2.3% 50188159 / 48279691 / +4.0% 0.60 / 0.63 / -6.0%
tpch_q03/duckdb:vortex-file-compressed 35422566 / 35203588 / +0.6% 83172487 / 80171872 / +3.7% 0.43 / 0.44 / -3.0%
tpch_q04/duckdb:vortex-file-compressed 32576315 / 31524213 / +3.3% 70582351 / 68232415 / +3.4% 0.46 / 0.46 / -0.1%
tpch_q05/duckdb:vortex-file-compressed 41186787 / 41812306 / -1.5% 76931811 / 84960466 / -9.4% 0.54 / 0.49 / +8.8%
tpch_q06/duckdb:vortex-file-compressed 8988777 / 9244262 / -2.8% 36690596 / 36604874 / +0.2% 0.24 / 0.25 / -3.0%
tpch_q07/duckdb:vortex-file-compressed 39884644 / 39879383 / +0.0% 88449959 / 90557728 / -2.3% 0.45 / 0.44 / +2.4%
tpch_q08/duckdb:vortex-file-compressed 50613148 / 47964676 / +5.5% 88710154 / 95002361 / -6.6% 0.57 / 0.50 / +13.0%
tpch_q09/duckdb:vortex-file-compressed 59950971 / 61641891 / -2.7% 109220490 / 102045167 / +7.0% 0.55 / 0.60 / -9.1%
tpch_q10/duckdb:vortex-file-compressed 48877398 / 47550260 / +2.8% 89070451 / 86679901 / +2.8% 0.55 / 0.55 / +0.0%
tpch_q11/duckdb:vortex-file-compressed 16732660 / 16385813 / +2.1% 38981102 / 34046548 / +14.5% 🔴 0.43 / 0.48 / -10.8%
tpch_q12/duckdb:vortex-file-compressed 27132105 / 26307857 / +3.1% 65626065 / 65329417 / +0.5% 0.41 / 0.40 / +2.7%
tpch_q13/duckdb:vortex-file-compressed 43811903 / 45735517 / -4.2% 117252965 / 118673852 / -1.2% 0.37 / 0.39 / -3.0%
tpch_q14/duckdb:vortex-file-compressed 21173420 / 22131748 / -4.3% 58331153 / 56290913 / +3.6% 0.36 / 0.39 / -7.7%
tpch_q15/duckdb:vortex-file-compressed 17115435 / 17498339 / -2.2% 58786245 / 55853136 / +5.3% 0.29 / 0.31 / -7.1%
tpch_q16/duckdb:vortex-file-compressed 30445660 / 31235847 / -2.5% 46200376 / 45536224 / +1.5% 0.66 / 0.69 / -3.9%
tpch_q17/duckdb:vortex-file-compressed 32826676 / 32313895 / +1.6% 88881770 / 84566724 / +5.1% 0.37 / 0.38 / -3.3%
tpch_q18/duckdb:vortex-file-compressed 48824312 / 53365184 / -8.5% 79232623 / 89563265 / -11.5% 🟢 0.62 / 0.60 / +3.4%
tpch_q19/duckdb:vortex-file-compressed 34657656 / 39174402 / -11.5% 🟢 65997377 / 69098406 / -4.5% 0.53 / 0.57 / -7.4%
tpch_q20/duckdb:vortex-file-compressed 33609364 / 34519250 / -2.6% 83688923 / 84153833 / -0.6% 0.40 / 0.41 / -2.1%
tpch_q21/duckdb:vortex-file-compressed 122142923 / 118475678 / +3.1% 164669882 / 160074237 / +2.9% 0.74 / 0.74 / +0.2%
tpch_q22/duckdb:vortex-file-compressed 19989531 / 22025004 / -9.2% 42501465 / 41070871 / +3.5% 0.47 / 0.54 / -12.3%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 81843988 / 81758568 / +0.1% 93291356 / 93429139 / -0.1% 0.88 / 0.88 / +0.3%
tpch_q02/duckdb:parquet 45650108 / 45675571 / -0.1% 63766631 / 61543753 / +3.6% 0.72 / 0.74 / -3.5%
tpch_q03/duckdb:parquet 81124273 / 81096675 / +0.0% 104451864 / 103202436 / +1.2% 0.78 / 0.79 / -1.2%
tpch_q04/duckdb:parquet 58862180 / 59027025 / -0.3% 76728838 / 78225225 / -1.9% 0.77 / 0.75 / +1.7%
tpch_q05/duckdb:parquet 78185155 / 79110812 / -1.2% 99215561 / 101225102 / -2.0% 0.79 / 0.78 / +0.8%
tpch_q06/duckdb:parquet 24934580 / 25449056 / -2.0% 33467365 / 33375305 / +0.3% 0.75 / 0.76 / -2.3%
tpch_q07/duckdb:parquet 80344361 / 80339544 / +0.0% 99703241 / 101269369 / -1.5% 0.81 / 0.79 / +1.6%
tpch_q08/duckdb:parquet 97117896 / 96590608 / +0.5% 120323481 / 122732278 / -2.0% 0.81 / 0.79 / +2.6%
tpch_q09/duckdb:parquet 152198580 / 148320540 / +2.6% 171052847 / 172960618 / -1.1% 0.89 / 0.86 / +3.8%
tpch_q10/duckdb:parquet 142734505 / 141842728 / +0.6% 183215100 / 164181777 / +11.6% 🔴 0.78 / 0.86 / -9.8%
tpch_q11/duckdb:parquet 25322598 / 25610546 / -1.1% 36201408 / 36079745 / +0.3% 0.70 / 0.71 / -1.5%
tpch_q12/duckdb:parquet 53588975 / 53241369 / +0.7% 69910012 / 68164967 / +2.6% 0.77 / 0.78 / -1.9%
tpch_q13/duckdb:parquet 285860903 / 287039614 / -0.4% 311807062 / 303307525 / +2.8% 0.92 / 0.95 / -3.1%
tpch_q14/duckdb:parquet 55995667 / 56301849 / -0.5% 71634113 / 71219172 / +0.6% 0.78 / 0.79 / -1.1%
tpch_q15/duckdb:parquet 30980757 / 31197426 / -0.7% 46243297 / 43549213 / +6.2% 0.67 / 0.72 / -6.5%
tpch_q16/duckdb:parquet 67402046 / 66967457 / +0.6% 82712031 / 82126514 / +0.7% 0.81 / 0.82 / -0.1%
tpch_q17/duckdb:parquet 58229162 / 58342372 / -0.2% 80071596 / 80239767 / -0.2% 0.73 / 0.73 / +0.0%
tpch_q18/duckdb:parquet 127112458 / 128113205 / -0.8% 146571196 / 142456441 / +2.9% 0.87 / 0.90 / -3.6%
tpch_q19/duckdb:parquet 78091941 / 77973783 / +0.2% 96192685 / 98050225 / -1.9% 0.81 / 0.80 / +2.1%
tpch_q20/duckdb:parquet 77174622 / 77758243 / -0.8% 103482037 / 102069733 / +1.4% 0.75 / 0.76 / -2.1%
tpch_q21/duckdb:parquet 188732538 / 196929800 / -4.2% 212198375 / 206999648 / +2.5% 0.89 / 0.95 / -6.5%
tpch_q22/duckdb:parquet 64906415 / 64834096 / +0.1% 80925426 / 78433060 / +3.2% 0.80 / 0.83 / -3.0%

No file size changes detected.

@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR ff9eddd4 vs base 68e2aee0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -7.5%
Engines: DataFusion No clear signal (-10.2%, low confidence) · DuckDB No clear signal (-4.6%, low confidence)
Vortex (geomean): hot 0.945x ➖ · cold 0.958x ➖
Parquet (geomean): hot 1.021x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +2.1% · Median polish +1.7%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.929x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed 208368971 / 481456486 / -56.7% 🟢 524272109 / 869375556 / -39.7% 🟢 0.40 / 0.55 / -28.2%
clickbench-sorted_q24/datafusion:vortex-file-compressed 27807520 / 25699087 / +8.2% 88828381 / 89345380 / -0.6% 0.31 / 0.29 / +8.8%
clickbench-sorted_q26/datafusion:vortex-file-compressed 25650936 / 25430846 / +0.9% 88771019 / 94516830 / -6.1% 0.29 / 0.27 / +7.4%
clickbench-sorted_q36/datafusion:vortex-file-compressed 51114886 / 50283386 / +1.7% 129005306 / 126362177 / +2.1% 0.40 / 0.40 / -0.4%
clickbench-sorted_q37/datafusion:vortex-file-compressed 40326597 / 40712690 / -0.9% 110977825 / 112174766 / -1.1% 0.36 / 0.36 / +0.1%
clickbench-sorted_q38/datafusion:vortex-file-compressed 50534706 / 49858288 / +1.4% 112809221 / 119288868 / -5.4% 0.45 / 0.42 / +7.2%
clickbench-sorted_q39/datafusion:vortex-file-compressed 124573287 / 125842738 / -1.0% 195420644 / 200273875 / -2.4% 0.64 / 0.63 / +1.4%
clickbench-sorted_q40/datafusion:vortex-file-compressed 21460646 / 21215175 / +1.2% 81096794 / 80411411 / +0.9% 0.26 / 0.26 / +0.3%
clickbench-sorted_q41/datafusion:vortex-file-compressed 20589423 / 20070321 / +2.6% 81466907 / 81348162 / +0.1% 0.25 / 0.25 / +2.4%
clickbench-sorted_q42/datafusion:vortex-file-compressed 15968708 / 16586233 / -3.7% 69373625 / 71076079 / -2.4% 0.23 / 0.23 / -1.4%
datafusion / parquet / ns (1.034x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet 2509524120 / 2504975778 / +0.2% 2978743551 / 2951558227 / +0.9% 0.84 / 0.85 / -0.7%
clickbench-sorted_q24/datafusion:parquet 17170405 / 16073676 / +6.8% 115054367 / 112924976 / +1.9% 0.15 / 0.14 / +4.8%
clickbench-sorted_q26/datafusion:parquet 17202574 / 15962980 / +7.8% 119968739 / 118922070 / +0.9% 0.14 / 0.13 / +6.8%
clickbench-sorted_q36/datafusion:parquet 163347122 / 153475931 / +6.4% 269374595 / 279839396 / -3.7% 0.61 / 0.55 / +10.6%
clickbench-sorted_q37/datafusion:parquet 100823060 / 96211918 / +4.8% 210420241 / 213011245 / -1.2% 0.48 / 0.45 / +6.1%
clickbench-sorted_q38/datafusion:parquet 149576630 / 136301072 / +9.7% 251270156 / 266487111 / -5.7% 0.60 / 0.51 / +16.4%
clickbench-sorted_q39/datafusion:parquet 284389081 / 274828042 / +3.5% 431410082 / 403404746 / +6.9% 0.66 / 0.68 / -3.2%
clickbench-sorted_q40/datafusion:parquet 61320100 / 62473338 / -1.8% 182655121 / 185137014 / -1.3% 0.34 / 0.34 / -0.5%
clickbench-sorted_q41/datafusion:parquet 59949466 / 60721970 / -1.3% 174190109 / 173198767 / +0.6% 0.34 / 0.35 / -1.8%
clickbench-sorted_q42/datafusion:parquet 35127878 / 35602619 / -1.3% 136669186 / 133724113 / +2.2% 0.26 / 0.27 / -3.5%
duckdb / vortex-file-compressed / ns (0.962x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed 102030940 / 115693500 / -11.8% 🟢 206458075 / 204770897 / +0.8% 0.49 / 0.56 / -12.5%
clickbench-sorted_q24/duckdb:vortex-file-compressed 30365168 / 31801672 / -4.5% 76623018 / 75704882 / +1.2% 0.40 / 0.42 / -5.7%
clickbench-sorted_q26/duckdb:vortex-file-compressed 27530946 / 29510633 / -6.7% 74674736 / 72702423 / +2.7% 0.37 / 0.41 / -9.2%
clickbench-sorted_q36/duckdb:vortex-file-compressed 75377554 / 76804760 / -1.9% 180260798 / 184779071 / -2.4% 0.42 / 0.42 / +0.6%
clickbench-sorted_q37/duckdb:vortex-file-compressed 62413622 / 62416884 / -0.0% 150616182 / 153988134 / -2.2% 0.41 / 0.41 / +2.2%
clickbench-sorted_q38/duckdb:vortex-file-compressed 72537772 / 75252589 / -3.6% 162841812 / 176476667 / -7.7% 0.45 / 0.43 / +4.5%
clickbench-sorted_q39/duckdb:vortex-file-compressed 172514231 / 194242070 / -11.2% 🟢 279165088 / 288938289 / -3.4% 0.62 / 0.67 / -8.1%
clickbench-sorted_q40/duckdb:vortex-file-compressed 32698181 / 32364980 / +1.0% 106060768 / 118810363 / -10.7% 🟢 0.31 / 0.27 / +13.2%
clickbench-sorted_q41/duckdb:vortex-file-compressed 33236317 / 33623822 / -1.2% 117649350 / 115849533 / +1.6% 0.28 / 0.29 / -2.7%
clickbench-sorted_q42/duckdb:vortex-file-compressed 30274894 / 29426734 / +2.9% 109660716 / 108077933 / +1.5% 0.28 / 0.27 / +1.4%
duckdb / parquet / ns (1.009x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet 228211516 / 220172691 / +3.7% 278658005 / 266071814 / +4.7% 0.82 / 0.83 / -1.0%
clickbench-sorted_q24/duckdb:parquet 37113934 / 35967750 / +3.2% 61721143 / 58892945 / +4.8% 0.60 / 0.61 / -1.5%
clickbench-sorted_q26/duckdb:parquet 27004824 / 26566246 / +1.7% 48269482 / 49721397 / -2.9% 0.56 / 0.53 / +4.7%
clickbench-sorted_q36/duckdb:parquet 73077495 / 71968784 / +1.5% 102538346 / 98533547 / +4.1% 0.71 / 0.73 / -2.4%
clickbench-sorted_q37/duckdb:parquet 61017908 / 58067375 / +5.1% 89322493 / 95510956 / -6.5% 0.68 / 0.61 / +12.4%
clickbench-sorted_q38/duckdb:parquet 64398562 / 62292028 / +3.4% 92509089 / 95377206 / -3.0% 0.70 / 0.65 / +6.6%
clickbench-sorted_q39/duckdb:parquet 107972663 / 108408724 / -0.4% 160599446 / 156021468 / +2.9% 0.67 / 0.69 / -3.2%
clickbench-sorted_q40/duckdb:parquet 29605880 / 32058412 / -7.7% 71981804 / 71374308 / +0.9% 0.41 / 0.45 / -8.4%
clickbench-sorted_q41/duckdb:parquet 29509945 / 28809229 / +2.4% 64889232 / 63709053 / +1.9% 0.45 / 0.45 / +0.6%
clickbench-sorted_q42/duckdb:parquet 19690529 / 20385898 / -3.4% 44936101 / 42112298 / +6.7% 0.44 / 0.48 / -9.5%

File Size Changes (100 files changed, +0.0% overall, 61↑ 39↓)
File Scale Format Base HEAD Change %
hits_034.vortex 1.0 vortex-file-compressed 180.98 MB 183.00 MB +2.02 MB +1.1%
hits_090.vortex 1.0 vortex-file-compressed 191.70 MB 193.62 MB +1.92 MB +1.0%
hits_001.vortex 1.0 vortex-file-compressed 188.00 MB 189.49 MB +1.48 MB +0.8%
hits_060.vortex 1.0 vortex-file-compressed 192.08 MB 193.48 MB +1.40 MB +0.7%
hits_071.vortex 1.0 vortex-file-compressed 138.72 MB 139.51 MB +808.25 KB +0.6%
hits_015.vortex 1.0 vortex-file-compressed 130.30 MB 130.81 MB +525.45 KB +0.4%
hits_054.vortex 1.0 vortex-file-compressed 146.22 MB 146.78 MB +569.95 KB +0.4%
hits_057.vortex 1.0 vortex-file-compressed 159.04 MB 159.57 MB +550.25 KB +0.3%
hits_079.vortex 1.0 vortex-file-compressed 179.88 MB 180.44 MB +568.54 KB +0.3%
hits_088.vortex 1.0 vortex-file-compressed 171.23 MB 171.75 MB +533.88 KB +0.3%
hits_016.vortex 1.0 vortex-file-compressed 179.39 MB 179.91 MB +536.91 KB +0.3%
hits_021.vortex 1.0 vortex-file-compressed 153.44 MB 153.87 MB +438.27 KB +0.3%
hits_076.vortex 1.0 vortex-file-compressed 159.91 MB 160.32 MB +424.55 KB +0.3%
hits_029.vortex 1.0 vortex-file-compressed 198.96 MB 199.27 MB +322.88 KB +0.2%
hits_008.vortex 1.0 vortex-file-compressed 138.94 MB 139.15 MB +215.55 KB +0.2%
hits_070.vortex 1.0 vortex-file-compressed 199.36 MB 199.65 MB +298.34 KB +0.1%
hits_025.vortex 1.0 vortex-file-compressed 171.03 MB 171.27 MB +248.73 KB +0.1%
hits_032.vortex 1.0 vortex-file-compressed 153.67 MB 153.87 MB +209.62 KB +0.1%
hits_049.vortex 1.0 vortex-file-compressed 190.24 MB 190.49 MB +246.68 KB +0.1%
hits_068.vortex 1.0 vortex-file-compressed 159.97 MB 160.14 MB +179.55 KB +0.1%
hits_031.vortex 1.0 vortex-file-compressed 158.98 MB 159.13 MB +156.93 KB +0.1%
hits_067.vortex 1.0 vortex-file-compressed 130.71 MB 130.84 MB +128.67 KB +0.1%
hits_089.vortex 1.0 vortex-file-compressed 130.44 MB 130.57 MB +126.52 KB +0.1%
hits_072.vortex 1.0 vortex-file-compressed 101.69 MB 101.77 MB +83.47 KB +0.1%
hits_000.vortex 1.0 vortex-file-compressed 130.64 MB 130.74 MB +102.16 KB +0.1%
hits_062.vortex 1.0 vortex-file-compressed 169.84 MB 169.96 MB +122.45 KB +0.1%
hits_027.vortex 1.0 vortex-file-compressed 188.74 MB 188.87 MB +133.58 KB +0.1%
hits_051.vortex 1.0 vortex-file-compressed 171.67 MB 171.79 MB +116.29 KB +0.1%
hits_030.vortex 1.0 vortex-file-compressed 130.91 MB 131.00 MB +88.34 KB +0.1%
hits_010.vortex 1.0 vortex-file-compressed 168.01 MB 168.12 MB +111.59 KB +0.1%
hits_033.vortex 1.0 vortex-file-compressed 199.37 MB 199.50 MB +132.05 KB +0.1%
hits_044.vortex 1.0 vortex-file-compressed 199.49 MB 199.61 MB +127.88 KB +0.1%
hits_074.vortex 1.0 vortex-file-compressed 198.64 MB 198.76 MB +121.01 KB +0.1%
hits_086.vortex 1.0 vortex-file-compressed 191.14 MB 191.26 MB +115.68 KB +0.1%
hits_085.vortex 1.0 vortex-file-compressed 198.97 MB 199.09 MB +119.23 KB +0.1%
hits_041.vortex 1.0 vortex-file-compressed 130.26 MB 130.33 MB +70.08 KB +0.1%
hits_004.vortex 1.0 vortex-file-compressed 130.58 MB 130.64 MB +66.22 KB +0.0%
hits_002.vortex 1.0 vortex-file-compressed 159.96 MB 160.03 MB +78.09 KB +0.0%
hits_019.vortex 1.0 vortex-file-compressed 139.57 MB 139.64 MB +66.73 KB +0.0%
hits_011.vortex 1.0 vortex-file-compressed 198.49 MB 198.58 MB +94.63 KB +0.0%
hits_073.vortex 1.0 vortex-file-compressed 171.84 MB 171.92 MB +81.88 KB +0.0%
hits_064.vortex 1.0 vortex-file-compressed 189.82 MB 189.89 MB +76.38 KB +0.0%
hits_039.vortex 1.0 vortex-file-compressed 160.05 MB 160.12 MB +61.69 KB +0.0%
hits_065.vortex 1.0 vortex-file-compressed 160.26 MB 160.31 MB +56.47 KB +0.0%
hits_098.vortex 1.0 vortex-file-compressed 136.69 MB 136.74 MB +48.01 KB +0.0%
hits_083.vortex 1.0 vortex-file-compressed 156.07 MB 156.12 MB +53.59 KB +0.0%
hits_082.vortex 1.0 vortex-file-compressed 139.08 MB 139.13 MB +47.64 KB +0.0%
hits_093.vortex 1.0 vortex-file-compressed 130.77 MB 130.81 MB +40.78 KB +0.0%
hits_091.vortex 1.0 vortex-file-compressed 146.12 MB 146.16 MB +44.73 KB +0.0%
hits_055.vortex 1.0 vortex-file-compressed 198.93 MB 198.98 MB +55.98 KB +0.0%
hits_040.vortex 1.0 vortex-file-compressed 142.10 MB 142.14 MB +38.11 KB +0.0%
hits_056.vortex 1.0 vortex-file-compressed 134.52 MB 134.56 MB +32.80 KB +0.0%
hits_017.vortex 1.0 vortex-file-compressed 145.83 MB 145.86 MB +33.80 KB +0.0%
hits_080.vortex 1.0 vortex-file-compressed 126.18 MB 126.20 MB +28.70 KB +0.0%
hits_014.vortex 1.0 vortex-file-compressed 171.37 MB 171.40 MB +37.87 KB +0.0%
hits_003.vortex 1.0 vortex-file-compressed 135.71 MB 135.74 MB +29.61 KB +0.0%
hits_061.vortex 1.0 vortex-file-compressed 159.77 MB 159.80 MB +32.84 KB +0.0%
hits_069.vortex 1.0 vortex-file-compressed 141.58 MB 141.59 MB +13.98 KB +0.0%
hits_059.vortex 1.0 vortex-file-compressed 198.36 MB 198.38 MB +12.95 KB +0.0%
hits_036.vortex 1.0 vortex-file-compressed 170.68 MB 170.69 MB +10.01 KB +0.0%
hits_042.vortex 1.0 vortex-file-compressed 201.06 MB 201.06 MB +648 B +0.0%
hits_037.vortex 1.0 vortex-file-compressed 176.53 MB 176.52 MB 4.05 KB -0.0%
hits_095.vortex 1.0 vortex-file-compressed 153.37 MB 153.37 MB 4.05 KB -0.0%
hits_048.vortex 1.0 vortex-file-compressed 199.01 MB 198.96 MB 48.84 KB -0.0%
hits_006.vortex 1.0 vortex-file-compressed 125.68 MB 125.65 MB 34.26 KB -0.0%
hits_013.vortex 1.0 vortex-file-compressed 160.24 MB 160.19 MB 46.38 KB -0.0%
hits_005.vortex 1.0 vortex-file-compressed 166.66 MB 166.61 MB 52.89 KB -0.0%
hits_084.vortex 1.0 vortex-file-compressed 153.52 MB 153.47 MB 53.76 KB -0.0%
hits_087.vortex 1.0 vortex-file-compressed 160.00 MB 159.94 MB 56.35 KB -0.0%
hits_007.vortex 1.0 vortex-file-compressed 198.51 MB 198.42 MB 97.17 KB -0.0%
hits_024.vortex 1.0 vortex-file-compressed 159.52 MB 159.43 MB 95.37 KB -0.1%
hits_099.vortex 1.0 vortex-file-compressed 170.60 MB 170.50 MB 103.38 KB -0.1%
hits_094.vortex 1.0 vortex-file-compressed 157.30 MB 157.20 MB 108.72 KB -0.1%
hits_018.vortex 1.0 vortex-file-compressed 199.10 MB 198.95 MB 151.03 KB -0.1%
hits_038.vortex 1.0 vortex-file-compressed 189.15 MB 188.99 MB 164.43 KB -0.1%
hits_063.vortex 1.0 vortex-file-compressed 130.91 MB 130.79 MB 126.34 KB -0.1%
hits_078.vortex 1.0 vortex-file-compressed 130.17 MB 130.05 MB 125.70 KB -0.1%
hits_047.vortex 1.0 vortex-file-compressed 153.70 MB 153.54 MB 157.73 KB -0.1%
hits_097.vortex 1.0 vortex-file-compressed 191.88 MB 191.65 MB 229.07 KB -0.1%
hits_009.vortex 1.0 vortex-file-compressed 100.67 MB 100.55 MB 130.88 KB -0.1%
hits_077.vortex 1.0 vortex-file-compressed 171.97 MB 171.74 MB 227.11 KB -0.1%
hits_046.vortex 1.0 vortex-file-compressed 100.61 MB 100.47 MB 148.04 KB -0.1%
hits_053.vortex 1.0 vortex-file-compressed 190.71 MB 190.42 MB 299.57 KB -0.2%
hits_066.vortex 1.0 vortex-file-compressed 162.47 MB 162.22 MB 257.30 KB -0.2%
hits_043.vortex 1.0 vortex-file-compressed 125.96 MB 125.76 MB 211.52 KB -0.2%
hits_092.vortex 1.0 vortex-file-compressed 199.49 MB 199.04 MB 461.00 KB -0.2%
hits_058.vortex 1.0 vortex-file-compressed 154.64 MB 154.29 MB 364.76 KB -0.2%
hits_081.vortex 1.0 vortex-file-compressed 199.63 MB 199.13 MB 511.00 KB -0.2%
hits_045.vortex 1.0 vortex-file-compressed 139.09 MB 138.72 MB 382.81 KB -0.3%
hits_020.vortex 1.0 vortex-file-compressed 159.64 MB 159.21 MB 444.95 KB -0.3%
hits_035.vortex 1.0 vortex-file-compressed 102.40 MB 102.11 MB 291.85 KB -0.3%
hits_012.vortex 1.0 vortex-file-compressed 190.48 MB 189.93 MB 562.79 KB -0.3%
hits_026.vortex 1.0 vortex-file-compressed 130.59 MB 130.06 MB 536.69 KB -0.4%
hits_052.vortex 1.0 vortex-file-compressed 130.56 MB 129.94 MB 641.96 KB -0.5%
hits_028.vortex 1.0 vortex-file-compressed 151.80 MB 150.94 MB 881.08 KB -0.6%
hits_096.vortex 1.0 vortex-file-compressed 198.78 MB 197.51 MB 1.27 MB -0.6%
hits_023.vortex 1.0 vortex-file-compressed 195.38 MB 194.10 MB 1.28 MB -0.7%
hits_075.vortex 1.0 vortex-file-compressed 189.76 MB 188.35 MB 1.41 MB -0.7%
hits_050.vortex 1.0 vortex-file-compressed 160.06 MB 158.66 MB 1.40 MB -0.9%
hits_022.vortex 1.0 vortex-file-compressed 198.88 MB 196.96 MB 1.92 MB -1.0%

Totals:

  • vortex-file-compressed: 15.88 GB → 15.88 GB (+0.0%)

@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR ff9eddd4 vs base 68e2aee0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-0.2%, low confidence) · DuckDB No clear signal (+1.0%, environment too noisy confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.009x ➖
Parquet (geomean): hot 0.998x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.002x ➖, 2↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 28864239 / 30212676 / -4.5% 83296118 / 85876142 / -3.0% 0.35 / 0.35 / -1.5%
tpcds_q02/datafusion:vortex-file-compressed 52146463 / 51632459 / +1.0% 103778699 / 105102731 / -1.3% 0.50 / 0.49 / +2.3%
tpcds_q03/datafusion:vortex-file-compressed 15364979 / 15217914 / +1.0% 57353563 / 57476401 / -0.2% 0.27 / 0.26 / +1.2%
tpcds_q04/datafusion:vortex-file-compressed 191182646 / 187950184 / +1.7% 273570080 / 267550201 / +2.2% 0.70 / 0.70 / -0.5%
tpcds_q05/datafusion:vortex-file-compressed 60371626 / 61249630 / -1.4% 125898731 / 124172880 / +1.4% 0.48 / 0.49 / -2.8%
tpcds_q06/datafusion:vortex-file-compressed 26504734 / 26971398 / -1.7% 78031637 / 79098040 / -1.3% 0.34 / 0.34 / -0.4%
tpcds_q07/datafusion:vortex-file-compressed 41859797 / 41788704 / +0.2% 111608085 / 105962154 / +5.3% 0.38 / 0.39 / -4.9%
tpcds_q08/datafusion:vortex-file-compressed 29887439 / 30299862 / -1.4% 82117794 / 83427890 / -1.6% 0.36 / 0.36 / +0.2%
tpcds_q09/datafusion:vortex-file-compressed 24756600 / 25952831 / -4.6% 67821621 / 69124436 / -1.9% 0.37 / 0.38 / -2.8%
tpcds_q10/datafusion:vortex-file-compressed 38508364 / 38339764 / +0.4% 93910726 / 89258165 / +5.2% 0.41 / 0.43 / -4.5%
tpcds_q11/datafusion:vortex-file-compressed 107227144 / 106859150 / +0.3% 177939539 / 176401567 / +0.9% 0.60 / 0.61 / -0.5%
tpcds_q12/datafusion:vortex-file-compressed 19670880 / 20284648 / -3.0% 64333948 / 65103276 / -1.2% 0.31 / 0.31 / -1.9%
tpcds_q13/datafusion:vortex-file-compressed 42398940 / 42611982 / -0.5% 94583280 / 98236302 / -3.7% 0.45 / 0.43 / +3.3%
tpcds_q14/datafusion:vortex-file-compressed 141780152 / 140435610 / +1.0% 206322175 / 213386491 / -3.3% 0.69 / 0.66 / +4.4%
tpcds_q15/datafusion:vortex-file-compressed 29161141 / 28492444 / +2.3% 87586274 / 81813268 / +7.1% 0.33 / 0.35 / -4.4%
tpcds_q16/datafusion:vortex-file-compressed 27019940 / 26201220 / +3.1% 74915142 / 74396456 / +0.7% 0.36 / 0.35 / +2.4%
tpcds_q17/datafusion:vortex-file-compressed 69166442 / 67415844 / +2.6% 138635510 / 139793908 / -0.8% 0.50 / 0.48 / +3.5%
tpcds_q18/datafusion:vortex-file-compressed 82466164 / 81535680 / +1.1% 154965723 / 151002163 / +2.6% 0.53 / 0.54 / -1.4%
tpcds_q19/datafusion:vortex-file-compressed 24126834 / 24073649 / +0.2% 78593514 / 76921668 / +2.2% 0.31 / 0.31 / -1.9%
tpcds_q20/datafusion:vortex-file-compressed 24911538 / 24634689 / +1.1% 73515632 / 70473512 / +4.3% 0.34 / 0.35 / -3.1%
tpcds_q21/datafusion:vortex-file-compressed 29425623 / 29808233 / -1.3% 83108482 / 85722439 / -3.0% 0.35 / 0.35 / +1.8%
tpcds_q22/datafusion:vortex-file-compressed 94431930 / 118530142 / -20.3% 🟢 171342842 / 130728575 / +31.1% 🔴 0.55 / 0.91 / -39.2%
tpcds_q23/datafusion:vortex-file-compressed 128988154 / 129283425 / -0.2% 201950158 / 206819223 / -2.4% 0.64 / 0.63 / +2.2%
tpcds_q24/datafusion:vortex-file-compressed 84446755 / 82700876 / +2.1% 156239484 / 149433393 / +4.6% 0.54 / 0.55 / -2.3%
tpcds_q25/datafusion:vortex-file-compressed 67262862 / 65240502 / +3.1% 136618610 / 139964135 / -2.4% 0.49 / 0.47 / +5.6%
tpcds_q26/datafusion:vortex-file-compressed 37366466 / 37145336 / +0.6% 95182590 / 95676524 / -0.5% 0.39 / 0.39 / +1.1%
tpcds_q27/datafusion:vortex-file-compressed 92011711 / 89415968 / +2.9% 179762718 / 171465402 / +4.8% 0.51 / 0.52 / -1.8%
tpcds_q28/datafusion:vortex-file-compressed 22475333 / 23232620 / -3.3% 71328405 / 70006343 / +1.9% 0.32 / 0.33 / -5.1%
tpcds_q29/datafusion:vortex-file-compressed 68297762 / 65069490 / +5.0% 134322090 / 136229194 / -1.4% 0.51 / 0.48 / +6.5%
tpcds_q30/datafusion:vortex-file-compressed 35234738 / 34124834 / +3.3% 77933870 / 81185723 / -4.0% 0.45 / 0.42 / +7.6%
tpcds_q31/datafusion:vortex-file-compressed 73678558 / 73979214 / -0.4% 140703617 / 141827352 / -0.8% 0.52 / 0.52 / +0.4%
tpcds_q32/datafusion:vortex-file-compressed 17996551 / 18868324 / -4.6% 64074637 / 60789880 / +5.4% 0.28 / 0.31 / -9.5%
tpcds_q33/datafusion:vortex-file-compressed 32319552 / 32919294 / -1.8% 95726450 / 94958708 / +0.8% 0.34 / 0.35 / -2.6%
tpcds_q34/datafusion:vortex-file-compressed 25060022 / 25823888 / -3.0% 76050494 / 74768474 / +1.7% 0.33 / 0.35 / -4.6%
tpcds_q35/datafusion:vortex-file-compressed 49120076 / 47615960 / +3.2% 103017875 / 100953692 / +2.0% 0.48 / 0.47 / +1.1%
tpcds_q36/datafusion:vortex-file-compressed 61082697 / 60584772 / +0.8% 128925085 / 128044365 / +0.7% 0.47 / 0.47 / +0.1%
tpcds_q37/datafusion:vortex-file-compressed 17512164 / 16812784 / +4.2% 63507939 / 60997802 / +4.1% 0.28 / 0.28 / +0.0%
tpcds_q38/datafusion:vortex-file-compressed 39468226 / 39292638 / +0.4% 91569325 / 92882596 / -1.4% 0.43 / 0.42 / +1.9%
tpcds_q39/datafusion:vortex-file-compressed 93953656 / 94094305 / -0.1% 157820517 / 160134325 / -1.4% 0.60 / 0.59 / +1.3%
tpcds_q40/datafusion:vortex-file-compressed 31178948 / 31361268 / -0.6% 93884092 / 88186003 / +6.5% 0.33 / 0.36 / -6.6%
tpcds_q41/datafusion:vortex-file-compressed 18068904 / 17949119 / +0.7% 57868503 / 57024094 / +1.5% 0.31 / 0.31 / -0.8%
tpcds_q42/datafusion:vortex-file-compressed 14005111 / 13523825 / +3.6% 58163095 / 57103396 / +1.9% 0.24 / 0.24 / +1.7%
tpcds_q43/datafusion:vortex-file-compressed 18396166 / 17978742 / +2.3% 66620093 / 64679449 / +3.0% 0.28 / 0.28 / -0.7%
tpcds_q44/datafusion:vortex-file-compressed 33012366 / 32543758 / +1.4% 87983557 / 87389822 / +0.7% 0.38 / 0.37 / +0.8%
tpcds_q45/datafusion:vortex-file-compressed 32465746 / 31953924 / +1.6% 82538598 / 84738605 / -2.6% 0.39 / 0.38 / +4.3%
tpcds_q46/datafusion:vortex-file-compressed 33299269 / 32278764 / +3.2% 90318473 / 93712948 / -3.6% 0.37 / 0.34 / +7.0%
tpcds_q47/datafusion:vortex-file-compressed 119326449 / 119555711 / -0.2% 196843058 / 193023913 / +2.0% 0.61 / 0.62 / -2.1%
tpcds_q48/datafusion:vortex-file-compressed 32202477 / 32675843 / -1.4% 85915455 / 85222313 / +0.8% 0.37 / 0.38 / -2.2%
tpcds_q49/datafusion:vortex-file-compressed 66156279 / 65303774 / +1.3% 127527961 / 124290259 / +2.6% 0.52 / 0.53 / -1.3%
tpcds_q50/datafusion:vortex-file-compressed 44159238 / 42047632 / +5.0% 103775910 / 101053570 / +2.7% 0.43 / 0.42 / +2.3%
tpcds_q51/datafusion:vortex-file-compressed 72719245 / 73178400 / -0.6% 138874888 / 135235403 / +2.7% 0.52 / 0.54 / -3.2%
tpcds_q52/datafusion:vortex-file-compressed 14107174 / 14294032 / -1.3% 60531295 / 55872580 / +8.3% 0.23 / 0.26 / -8.9%
tpcds_q53/datafusion:vortex-file-compressed 23005192 / 22186901 / +3.7% 70996707 / 73525630 / -3.4% 0.32 / 0.30 / +7.4%
tpcds_q54/datafusion:vortex-file-compressed 37723358 / 37592899 / +0.3% 91277590 / 88960344 / +2.6% 0.41 / 0.42 / -2.2%
tpcds_q55/datafusion:vortex-file-compressed 14733554 / 14192087 / +3.8% 52414269 / 57145386 / -8.3% 0.28 / 0.25 / +13.2%
tpcds_q56/datafusion:vortex-file-compressed 32743508 / 32609124 / +0.4% 89086466 / 94272386 / -5.5% 0.37 / 0.35 / +6.3%
tpcds_q57/datafusion:vortex-file-compressed 92749701 / 94814880 / -2.2% 162351585 / 158620619 / +2.4% 0.57 / 0.60 / -4.4%
tpcds_q58/datafusion:vortex-file-compressed 55446052 / 54187192 / +2.3% 121060560 / 120239411 / +0.7% 0.46 / 0.45 / +1.6%
tpcds_q59/datafusion:vortex-file-compressed 51517744 / 53149010 / -3.1% 111110587 / 106903098 / +3.9% 0.46 / 0.50 / -6.7%
tpcds_q60/datafusion:vortex-file-compressed 33482050 / 32608942 / +2.7% 91736657 / 94281330 / -2.7% 0.36 / 0.35 / +5.5%
tpcds_q61/datafusion:vortex-file-compressed 36627270 / 37240556 / -1.6% 98663800 / 92513103 / +6.6% 0.37 / 0.40 / -7.8%
tpcds_q62/datafusion:vortex-file-compressed 23672866 / 23797274 / -0.5% 72506923 / 69968802 / +3.6% 0.33 / 0.34 / -4.0%
tpcds_q63/datafusion:vortex-file-compressed 21750962 / 22541878 / -3.5% 69153729 / 71965577 / -3.9% 0.31 / 0.31 / +0.4%
tpcds_q64/datafusion:vortex-file-compressed 371351000 / 373394420 / -0.5% 489763284 / 485362944 / +0.9% 0.76 / 0.77 / -1.4%
tpcds_q65/datafusion:vortex-file-compressed 66899153 / 65537528 / +2.1% 123687167 / 127296645 / -2.8% 0.54 / 0.51 / +5.1%
tpcds_q66/datafusion:vortex-file-compressed 71846011 / 71298740 / +0.8% 135560473 / 133190981 / +1.8% 0.53 / 0.54 / -1.0%
tpcds_q67/datafusion:vortex-file-compressed 114103640 / 114921013 / -0.7% 194464429 / 193053429 / +0.7% 0.59 / 0.60 / -1.4%
tpcds_q68/datafusion:vortex-file-compressed 31205782 / 30921339 / +0.9% 96083323 / 91559617 / +4.9% 0.32 / 0.34 / -3.8%
tpcds_q69/datafusion:vortex-file-compressed 37771434 / 37891978 / -0.3% 93491969 / 90334166 / +3.5% 0.40 / 0.42 / -3.7%
tpcds_q70/datafusion:vortex-file-compressed 111441871 / 109577646 / +1.7% 168494191 / 171276262 / -1.6% 0.66 / 0.64 / +3.4%
tpcds_q71/datafusion:vortex-file-compressed 24367162 / 24204390 / +0.7% 74814689 / 75944401 / -1.5% 0.33 / 0.32 / +2.2%
tpcds_q72/datafusion:vortex-file-compressed 1450772811 / 1446339115 / +0.3% 1537486896 / 1561897211 / -1.6% 0.94 / 0.93 / +1.9%
tpcds_q73/datafusion:vortex-file-compressed 25307376 / 23439542 / +8.0% 78563339 / 73099574 / +7.5% 0.32 / 0.32 / +0.5%
tpcds_q74/datafusion:vortex-file-compressed 68183548 / 68078050 / +0.2% 135010407 / 132200036 / +2.1% 0.51 / 0.51 / -1.9%
tpcds_q75/datafusion:vortex-file-compressed 132354800 / 132864678 / -0.4% 212922237 / 218312874 / -2.5% 0.62 / 0.61 / +2.1%
tpcds_q76/datafusion:vortex-file-compressed 40216679 / 39604344 / +1.5% 91535258 / 95732334 / -4.4% 0.44 / 0.41 / +6.2%
tpcds_q77/datafusion:vortex-file-compressed 43082844 / 41768076 / +3.1% 103040479 / 104299133 / -1.2% 0.42 / 0.40 / +4.4%
tpcds_q78/datafusion:vortex-file-compressed 106100410 / 106369962 / -0.3% 182064403 / 180837711 / +0.7% 0.58 / 0.59 / -0.9%
tpcds_q79/datafusion:vortex-file-compressed 27492922 / 27819424 / -1.2% 84809234 / 83100977 / +2.1% 0.32 / 0.33 / -3.2%
tpcds_q80/datafusion:vortex-file-compressed 97281146 / 97837789 / -0.6% 193753928 / 191665787 / +1.1% 0.50 / 0.51 / -1.6%
tpcds_q81/datafusion:vortex-file-compressed 35463716 / 35520274 / -0.2% 82462791 / 84389518 / -2.3% 0.43 / 0.42 / +2.2%
tpcds_q82/datafusion:vortex-file-compressed 18346346 / 17972548 / +2.1% 64359241 / 68366259 / -5.9% 0.29 / 0.26 / +8.4%
tpcds_q83/datafusion:vortex-file-compressed 46274027 / 45866452 / +0.9% 98490657 / 98312008 / +0.2% 0.47 / 0.47 / +0.7%
tpcds_q84/datafusion:vortex-file-compressed 14461545 / 16304392 / -11.3% 🟢 54782565 / 54043353 / +1.4% 0.26 / 0.30 / -12.5%
tpcds_q85/datafusion:vortex-file-compressed 64745422 / 62777119 / +3.1% 134642408 / 133294959 / +1.0% 0.48 / 0.47 / +2.1%
tpcds_q86/datafusion:vortex-file-compressed 19396102 / 19550124 / -0.8% 62392202 / 61472004 / +1.5% 0.31 / 0.32 / -2.3%
tpcds_q87/datafusion:vortex-file-compressed 38791768 / 39213510 / -1.1% 97723605 / 87965196 / +11.1% 🔴 0.40 / 0.45 / -11.0%
tpcds_q88/datafusion:vortex-file-compressed 51785254 / 50845812 / +1.8% 112787427 / 116680169 / -3.3% 0.46 / 0.44 / +5.4%
tpcds_q89/datafusion:vortex-file-compressed 26244308 / 25209780 / +4.1% 73660223 / 76923164 / -4.2% 0.36 / 0.33 / +8.7%
tpcds_q90/datafusion:vortex-file-compressed 14621693 / 13977662 / +4.6% 52755086 / 54672869 / -3.5% 0.28 / 0.26 / +8.4%
tpcds_q91/datafusion:vortex-file-compressed 23106490 / 22574645 / +2.4% 64935483 / 67869743 / -4.3% 0.36 / 0.33 / +7.0%
tpcds_q92/datafusion:vortex-file-compressed 17642657 / 17762477 / -0.7% 60652890 / 62504071 / -3.0% 0.29 / 0.28 / +2.4%
tpcds_q93/datafusion:vortex-file-compressed 30261562 / 30526587 / -0.9% 84492395 / 83982009 / +0.6% 0.36 / 0.36 / -1.5%
tpcds_q94/datafusion:vortex-file-compressed 23913406 / 23491046 / +1.8% 66978633 / 69525545 / -3.7% 0.36 / 0.34 / +5.7%
tpcds_q95/datafusion:vortex-file-compressed 52100423 / 52142704 / -0.1% 111114282 / 111417828 / -0.3% 0.47 / 0.47 / +0.2%
tpcds_q96/datafusion:vortex-file-compressed 12144742 / 12089664 / +0.5% 54304202 / 54285966 / +0.0% 0.22 / 0.22 / +0.4%
tpcds_q97/datafusion:vortex-file-compressed 27106333 / 27481780 / -1.4% 84631147 / 89792619 / -5.7% 0.32 / 0.31 / +4.6%
tpcds_q98/datafusion:vortex-file-compressed 21736836 / 22453611 / -3.2% 73878221 / 75128853 / -1.7% 0.29 / 0.30 / -1.6%
tpcds_q99/datafusion:vortex-file-compressed 27586090 / 28044942 / -1.6% 74306478 / 75453951 / -1.5% 0.37 / 0.37 / -0.1%
datafusion / parquet / ns (1.003x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 35426138 / 35070402 / +1.0% 79716843 / 74779871 / +6.6% 0.44 / 0.47 / -5.2%
tpcds_q02/datafusion:parquet 53948168 / 53514829 / +0.8% 99340778 / 100266973 / -0.9% 0.54 / 0.53 / +1.7%
tpcds_q03/datafusion:parquet 21844734 / 21666252 / +0.8% 63153730 / 64256010 / -1.7% 0.35 / 0.34 / +2.6%
tpcds_q04/datafusion:parquet 280347514 / 288616376 / -2.9% 359229886 / 350474005 / +2.5% 0.78 / 0.82 / -5.2%
tpcds_q05/datafusion:parquet 71909629 / 70123588 / +2.5% 139098295 / 133622206 / +4.1% 0.52 / 0.52 / -1.5%
tpcds_q06/datafusion:parquet 38723672 / 38255994 / +1.2% 83824758 / 86223788 / -2.8% 0.46 / 0.44 / +4.1%
tpcds_q07/datafusion:parquet 58080504 / 57824986 / +0.4% 120550274 / 118638156 / +1.6% 0.48 / 0.49 / -1.2%
tpcds_q08/datafusion:parquet 41565058 / 41298111 / +0.6% 97198685 / 90763226 / +7.1% 0.43 / 0.46 / -6.0%
tpcds_q09/datafusion:parquet 33480197 / 33719232 / -0.7% 86964070 / 84336848 / +3.1% 0.38 / 0.40 / -3.7%
tpcds_q10/datafusion:parquet 54149220 / 54842505 / -1.3% 100999430 / 95762573 / +5.5% 0.54 / 0.57 / -6.4%
tpcds_q11/datafusion:parquet 144052361 / 146162566 / -1.4% 201908026 / 218018241 / -7.4% 0.71 / 0.67 / +6.4%
tpcds_q12/datafusion:parquet 29929628 / 30260726 / -1.1% 69719631 / 72448278 / -3.8% 0.43 / 0.42 / +2.8%
tpcds_q13/datafusion:parquet 57760788 / 59364007 / -2.7% 117009400 / 115921864 / +0.9% 0.49 / 0.51 / -3.6%
tpcds_q14/datafusion:parquet 171322084 / 173644790 / -1.3% 238706594 / 230066885 / +3.8% 0.72 / 0.75 / -4.9%
tpcds_q15/datafusion:parquet 31082792 / 31199529 / -0.4% 80154628 / 83171593 / -3.6% 0.39 / 0.38 / +3.4%
tpcds_q16/datafusion:parquet 36993024 / 36094480 / +2.5% 81776110 / 81190027 / +0.7% 0.45 / 0.44 / +1.8%
tpcds_q17/datafusion:parquet 76824072 / 78357531 / -2.0% 160289290 / 156352814 / +2.5% 0.48 / 0.50 / -4.4%
tpcds_q18/datafusion:parquet 65410972 / 66096260 / -1.0% 123733949 / 131621569 / -6.0% 0.53 / 0.50 / +5.3%
tpcds_q19/datafusion:parquet 39854845 / 38041176 / +4.8% 89647267 / 90228542 / -0.6% 0.44 / 0.42 / +5.4%
tpcds_q20/datafusion:parquet 33863328 / 33406242 / +1.4% 75170654 / 72716692 / +3.4% 0.45 / 0.46 / -1.9%
tpcds_q21/datafusion:parquet 25471172 / 24368349 / +4.5% 68912366 / 66590833 / +3.5% 0.37 / 0.37 / +1.0%
tpcds_q22/datafusion:parquet 113909504 / 103663174 / +9.9% 153051963 / 216439830 / -29.3% 🟢 0.74 / 0.48 / +55.4%
tpcds_q23/datafusion:parquet 164120721 / 162559522 / +1.0% 233001750 / 229357546 / +1.6% 0.70 / 0.71 / -0.6%
tpcds_q24/datafusion:parquet 102231178 / 103251782 / -1.0% 171908996 / 171978293 / -0.0% 0.59 / 0.60 / -0.9%
tpcds_q25/datafusion:parquet 82599948 / 81040281 / +1.9% 155458168 / 157409224 / -1.2% 0.53 / 0.51 / +3.2%
tpcds_q26/datafusion:parquet 46087980 / 48566920 / -5.1% 97243488 / 94215788 / +3.2% 0.47 / 0.52 / -8.1%
tpcds_q27/datafusion:parquet 109870441 / 112068272 / -2.0% 196779216 / 203150669 / -3.1% 0.56 / 0.55 / +1.2%
tpcds_q28/datafusion:parquet 36064016 / 35565101 / +1.4% 88585089 / 92101827 / -3.8% 0.41 / 0.39 / +5.4%
tpcds_q29/datafusion:parquet 83335562 / 82821267 / +0.6% 163624619 / 161082060 / +1.6% 0.51 / 0.51 / -0.9%
tpcds_q30/datafusion:parquet 54999960 / 56958534 / -3.4% 101687799 / 99042480 / +2.7% 0.54 / 0.58 / -6.0%
tpcds_q31/datafusion:parquet 94215022 / 91462374 / +3.0% 148560763 / 147645990 / +0.6% 0.63 / 0.62 / +2.4%
tpcds_q32/datafusion:parquet 25936848 / 26672152 / -2.8% 68193498 / 68332858 / -0.2% 0.38 / 0.39 / -2.6%
tpcds_q33/datafusion:parquet 43859666 / 44616440 / -1.7% 92714190 / 97430190 / -4.8% 0.47 / 0.46 / +3.3%
tpcds_q34/datafusion:parquet 31364032 / 30566446 / +2.6% 71411431 / 73538570 / -2.9% 0.44 / 0.42 / +5.7%
tpcds_q35/datafusion:parquet 71143516 / 70550744 / +0.8% 121578799 / 116103189 / +4.7% 0.59 / 0.61 / -3.7%
tpcds_q36/datafusion:parquet 66400282 / 67035345 / -0.9% 137069223 / 141466415 / -3.1% 0.48 / 0.47 / +2.2%
tpcds_q37/datafusion:parquet 25708408 / 25466434 / +1.0% 69465632 / 70583812 / -1.6% 0.37 / 0.36 / +2.6%
tpcds_q38/datafusion:parquet 50900956 / 53940172 / -5.6% 109886349 / 108642030 / +1.1% 0.46 / 0.50 / -6.7%
tpcds_q39/datafusion:parquet 82943581 / 84598645 / -2.0% 149288139 / 141607788 / +5.4% 0.56 / 0.60 / -7.0%
tpcds_q40/datafusion:parquet 33641744 / 33035204 / +1.8% 87529021 / 84884570 / +3.1% 0.38 / 0.39 / -1.2%
tpcds_q41/datafusion:parquet 22491468 / 22553384 / -0.3% 63121985 / 62709078 / +0.7% 0.36 / 0.36 / -0.9%
tpcds_q42/datafusion:parquet 20287724 / 20544306 / -1.2% 60238796 / 59265578 / +1.6% 0.34 / 0.35 / -2.8%
tpcds_q43/datafusion:parquet 24915580 / 25832231 / -3.5% 64530606 / 66624775 / -3.1% 0.39 / 0.39 / -0.4%
tpcds_q44/datafusion:parquet 40265226 / 39872335 / +1.0% 98265079 / 95781037 / +2.6% 0.41 / 0.42 / -1.6%
tpcds_q45/datafusion:parquet 38970791 / 40234640 / -3.1% 90017586 / 95545216 / -5.8% 0.43 / 0.42 / +2.8%
tpcds_q46/datafusion:parquet 40451390 / 39950608 / +1.3% 94176998 / 96056929 / -2.0% 0.43 / 0.42 / +3.3%
tpcds_q47/datafusion:parquet 141392977 / 140390146 / +0.7% 212346930 / 208135088 / +2.0% 0.67 / 0.67 / -1.3%
tpcds_q48/datafusion:parquet 50997386 / 51385446 / -0.8% 105467047 / 106320642 / -0.8% 0.48 / 0.48 / +0.0%
tpcds_q49/datafusion:parquet 76568000 / 75450516 / +1.5% 148941963 / 143291715 / +3.9% 0.51 / 0.53 / -2.4%
tpcds_q50/datafusion:parquet 56864204 / 54167677 / +5.0% 112222211 / 112108994 / +0.1% 0.51 / 0.48 / +4.9%
tpcds_q51/datafusion:parquet 83095370 / 83212161 / -0.1% 138591784 / 132483724 / +4.6% 0.60 / 0.63 / -4.5%
tpcds_q52/datafusion:parquet 20763294 / 21174564 / -1.9% 59048538 / 59999377 / -1.6% 0.35 / 0.35 / -0.4%
tpcds_q53/datafusion:parquet 26587556 / 26497840 / +0.3% 75772795 / 75653856 / +0.2% 0.35 / 0.35 / +0.2%
tpcds_q54/datafusion:parquet 54552660 / 53858624 / +1.3% 105228244 / 103394901 / +1.8% 0.52 / 0.52 / -0.5%
tpcds_q55/datafusion:parquet 19727206 / 20251944 / -2.6% 59682048 / 60666041 / -1.6% 0.33 / 0.33 / -1.0%
tpcds_q56/datafusion:parquet 44791588 / 45643192 / -1.9% 99867832 / 99030603 / +0.8% 0.45 / 0.46 / -2.7%
tpcds_q57/datafusion:parquet 119405942 / 118750609 / +0.6% 179784752 / 184781633 / -2.7% 0.66 / 0.64 / +3.3%
tpcds_q58/datafusion:parquet 73609542 / 73978924 / -0.5% 128690817 / 129947697 / -1.0% 0.57 / 0.57 / +0.5%
tpcds_q59/datafusion:parquet 70987502 / 69970518 / +1.5% 119533222 / 121247084 / -1.4% 0.59 / 0.58 / +2.9%
tpcds_q60/datafusion:parquet 46118524 / 43098216 / +7.0% 102141445 / 99646918 / +2.5% 0.45 / 0.43 / +4.4%
tpcds_q61/datafusion:parquet 49710740 / 50871958 / -2.3% 114695205 / 112062822 / +2.3% 0.43 / 0.45 / -4.5%
tpcds_q62/datafusion:parquet 34110193 / 29690666 / +14.9% 🔴 70871536 / 69625291 / +1.8% 0.48 / 0.43 / +12.9%
tpcds_q63/datafusion:parquet 26073954 / 25967916 / +0.4% 68755510 / 74144599 / -7.3% 0.38 / 0.35 / +8.3%
tpcds_q64/datafusion:parquet 278938732 / 278406112 / +0.2% 370759732 / 369348615 / +0.4% 0.75 / 0.75 / -0.2%
tpcds_q65/datafusion:parquet 44610107 / 45793107 / -2.6% 96031077 / 100340861 / -4.3% 0.46 / 0.46 / +1.8%
tpcds_q66/datafusion:parquet 79499618 / 83010662 / -4.2% 129745980 / 126942453 / +2.2% 0.61 / 0.65 / -6.3%
tpcds_q67/datafusion:parquet 139921034 / 135771787 / +3.1% 211595428 / 198459353 / +6.6% 0.66 / 0.68 / -3.3%
tpcds_q68/datafusion:parquet 37843211 / 39468030 / -4.1% 99488489 / 101178157 / -1.7% 0.38 / 0.39 / -2.5%
tpcds_q69/datafusion:parquet 57775442 / 56545142 / +2.2% 102834508 / 103277869 / -0.4% 0.56 / 0.55 / +2.6%
tpcds_q70/datafusion:parquet 47616922 / 48342148 / -1.5% 93176564 / 92985045 / +0.2% 0.51 / 0.52 / -1.7%
tpcds_q71/datafusion:parquet 31590152 / 33150488 / -4.7% 78754586 / 82857705 / -5.0% 0.40 / 0.40 / +0.3%
tpcds_q72/datafusion:parquet 398822466 / 399503881 / -0.2% 500501165 / 511602955 / -2.2% 0.80 / 0.78 / +2.0%
tpcds_q73/datafusion:parquet 31604342 / 30984772 / +2.0% 70169436 / 70073833 / +0.1% 0.45 / 0.44 / +1.9%
tpcds_q74/datafusion:parquet 95004528 / 93600478 / +1.5% 148440154 / 141818860 / +4.7% 0.64 / 0.66 / -3.0%
tpcds_q75/datafusion:parquet 146069665 / 146465866 / -0.3% 234411450 / 237947098 / -1.5% 0.62 / 0.62 / +1.2%
tpcds_q76/datafusion:parquet 48348789 / 46671596 / +3.6% 108845909 / 107852037 / +0.9% 0.44 / 0.43 / +2.6%
tpcds_q77/datafusion:parquet 59161284 / 57224226 / +3.4% 110507252 / 114737450 / -3.7% 0.54 / 0.50 / +7.3%
tpcds_q78/datafusion:parquet 115890676 / 119472426 / -3.0% 204090441 / 204708462 / -0.3% 0.57 / 0.58 / -2.7%
tpcds_q79/datafusion:parquet 35064504 / 34631384 / +1.3% 85589758 / 83855699 / +2.1% 0.41 / 0.41 / -0.8%
tpcds_q80/datafusion:parquet 97594251 / 97282758 / +0.3% 192561063 / 194747325 / -1.1% 0.51 / 0.50 / +1.5%
tpcds_q81/datafusion:parquet 51987666 / 51357380 / +1.2% 101674259 / 98246961 / +3.5% 0.51 / 0.52 / -2.2%
tpcds_q82/datafusion:parquet 28610148 / 27584666 / +3.7% 69077910 / 72213267 / -4.3% 0.41 / 0.38 / +8.4%
tpcds_q83/datafusion:parquet 61839626 / 63657263 / -2.9% 114335744 / 107663920 / +6.2% 0.54 / 0.59 / -8.5%
tpcds_q84/datafusion:parquet 33747264 / 33617922 / +0.4% 73811868 / 69154460 / +6.7% 0.46 / 0.49 / -5.9%
tpcds_q85/datafusion:parquet 90768054 / 89651642 / +1.2% 160119397 / 159178710 / +0.6% 0.57 / 0.56 / +0.7%
tpcds_q86/datafusion:parquet 23441507 / 23477808 / -0.2% 60903066 / 63017368 / -3.4% 0.38 / 0.37 / +3.3%
tpcds_q87/datafusion:parquet 50352534 / 52247937 / -3.6% 101447245 / 105149887 / -3.5% 0.50 / 0.50 / -0.1%
tpcds_q88/datafusion:parquet 55743783 / 56902982 / -2.0% 112657663 / 117704334 / -4.3% 0.49 / 0.48 / +2.4%
tpcds_q89/datafusion:parquet 30210522 / 29431168 / +2.6% 82479275 / 80570435 / +2.4% 0.37 / 0.37 / +0.3%
tpcds_q90/datafusion:parquet 21612624 / 21436304 / +0.8% 58127078 / 57335982 / +1.4% 0.37 / 0.37 / -0.5%
tpcds_q91/datafusion:parquet 43174146 / 43359698 / -0.4% 85926074 / 91393649 / -6.0% 0.50 / 0.47 / +5.9%
tpcds_q92/datafusion:parquet 25107783 / 24430510 / +2.8% 69416383 / 70852985 / -2.0% 0.36 / 0.34 / +4.9%
tpcds_q93/datafusion:parquet 34591842 / 33315716 / +3.8% 91515568 / 91851524 / -0.4% 0.38 / 0.36 / +4.2%
tpcds_q94/datafusion:parquet 35928130 / 35740061 / +0.5% 75009556 / 77368016 / -3.0% 0.48 / 0.46 / +3.7%
tpcds_q95/datafusion:parquet 61413910 / 59718256 / +2.8% 109544530 / 112900813 / -3.0% 0.56 / 0.53 / +6.0%
tpcds_q96/datafusion:parquet 19175915 / 18154968 / +5.6% 52265480 / 53388900 / -2.1% 0.37 / 0.34 / +7.9%
tpcds_q97/datafusion:parquet 39636724 / 40425052 / -2.0% 90286107 / 92327643 / -2.2% 0.44 / 0.44 / +0.3%
tpcds_q98/datafusion:parquet 31446911 / 31397036 / +0.2% 81139158 / 76924857 / +5.5% 0.39 / 0.41 / -5.0%
tpcds_q99/datafusion:parquet 34994427 / 33814504 / +3.5% 79224097 / 79354875 / -0.2% 0.44 / 0.43 / +3.7%
duckdb / vortex-file-compressed / ns (1.002x ➖, 1↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 23292162 / 25232118 / -7.7% 40767583 / 44115542 / -7.6% 0.57 / 0.57 / -0.1%
tpcds_q02/duckdb:vortex-file-compressed 27695826 / 28228977 / -1.9% 50577960 / 48164191 / +5.0% 0.55 / 0.59 / -6.6%
tpcds_q03/duckdb:vortex-file-compressed 20260458 / 20822290 / -2.7% 40056352 / 40997593 / -2.3% 0.51 / 0.51 / -0.4%
tpcds_q04/duckdb:vortex-file-compressed 94183440 / 94599078 / -0.4% 124295085 / 124185133 / +0.1% 0.76 / 0.76 / -0.5%
tpcds_q05/duckdb:vortex-file-compressed 34970842 / 33872336 / +3.2% 58869916 / 53801599 / +9.4% 0.59 / 0.63 / -5.6%
tpcds_q06/duckdb:vortex-file-compressed 43284418 / 44150790 / -2.0% 75544081 / 72204289 / +4.6% 0.57 / 0.61 / -6.3%
tpcds_q07/duckdb:vortex-file-compressed 27528136 / 28673565 / -4.0% 60926627 / 62489504 / -2.5% 0.45 / 0.46 / -1.5%
tpcds_q08/duckdb:vortex-file-compressed 37338364 / 35222365 / +6.0% 62537956 / 58815907 / +6.3% 0.60 / 0.60 / -0.3%
tpcds_q09/duckdb:vortex-file-compressed 16993250 / 16530040 / +2.8% 55519782 / 49097208 / +13.1% 🔴 0.31 / 0.34 / -9.1%
tpcds_q10/duckdb:vortex-file-compressed 50949781 / 49842202 / +2.2% 88556071 / 77695392 / +14.0% 🔴 0.58 / 0.64 / -10.3%
tpcds_q11/duckdb:vortex-file-compressed 73572772 / 74331034 / -1.0% 104713618 / 102128663 / +2.5% 0.70 / 0.73 / -3.5%
tpcds_q12/duckdb:vortex-file-compressed 16338021 / 16597896 / -1.6% 38005643 / 34762131 / +9.3% 0.43 / 0.48 / -10.0%
tpcds_q13/duckdb:vortex-file-compressed 39407550 / 36302182 / +8.6% 71344405 / 69244383 / +3.0% 0.55 / 0.52 / +5.4%
tpcds_q14/duckdb:vortex-file-compressed 105175004 / 105076974 / +0.1% 149532606 / 149798606 / -0.2% 0.70 / 0.70 / +0.3%
tpcds_q15/duckdb:vortex-file-compressed 34528090 / 32374710 / +6.7% 52033090 / 50406270 / +3.2% 0.66 / 0.64 / +3.3%
tpcds_q16/duckdb:vortex-file-compressed 30797591 / 34117946 / -9.7% 49535846 / 56010116 / -11.6% 🟢 0.62 / 0.61 / +2.1%
tpcds_q17/duckdb:vortex-file-compressed 51761059 / 50989440 / +1.5% 90646160 / 84641043 / +7.1% 0.57 / 0.60 / -5.2%
tpcds_q18/duckdb:vortex-file-compressed 46601514 / 47630540 / -2.2% 71386655 / 70297952 / +1.5% 0.65 / 0.68 / -3.7%
tpcds_q19/duckdb:vortex-file-compressed 37954176 / 39721938 / -4.5% 66162052 / 65298843 / +1.3% 0.57 / 0.61 / -5.7%
tpcds_q20/duckdb:vortex-file-compressed 18934745 / 17568877 / +7.8% 37024963 / 33618806 / +10.1% 🔴 0.51 / 0.52 / -2.1%
tpcds_q21/duckdb:vortex-file-compressed 21249604 / 18309921 / +16.1% 🔴 57667165 / 59871692 / -3.7% 0.37 / 0.31 / +20.5%
tpcds_q22/duckdb:vortex-file-compressed 64401736 / 65316629 / -1.4% 103454499 / 95670052 / +8.1% 0.62 / 0.68 / -8.8%
tpcds_q23/duckdb:vortex-file-compressed 68278668 / 69029510 / -1.1% 115949482 / 114254518 / +1.5% 0.59 / 0.60 / -2.5%
tpcds_q24/duckdb:vortex-file-compressed 48514819 / 47686281 / +1.7% 83333186 / 85153064 / -2.1% 0.58 / 0.56 / +4.0%
tpcds_q25/duckdb:vortex-file-compressed 42188205 / 41361488 / +2.0% 74375328 / 74369228 / +0.0% 0.57 / 0.56 / +2.0%
tpcds_q26/duckdb:vortex-file-compressed 23985236 / 23573342 / +1.7% 43134695 / 43898596 / -1.7% 0.56 / 0.54 / +3.5%
tpcds_q27/duckdb:vortex-file-compressed 31688118 / 31744467 / -0.2% 64960449 / 59390694 / +9.4% 0.49 / 0.53 / -8.7%
tpcds_q28/duckdb:vortex-file-compressed 11407119 / 12891659 / -11.5% 🟢 25732722 / 30099024 / -14.5% 🟢 0.44 / 0.43 / +3.5%
tpcds_q29/duckdb:vortex-file-compressed 49393198 / 49800648 / -0.8% 83671580 / 85219428 / -1.8% 0.59 / 0.58 / +1.0%
tpcds_q30/duckdb:vortex-file-compressed 32626338 / 33107906 / -1.5% 50366546 / 55593689 / -9.4% 0.65 / 0.60 / +8.8%
tpcds_q31/duckdb:vortex-file-compressed 31766542 / 33355602 / -4.8% 57113394 / 57418635 / -0.5% 0.56 / 0.58 / -4.3%
tpcds_q32/duckdb:vortex-file-compressed 16880605 / 17508160 / -3.6% 41694121 / 30265560 / +37.8% 🔴 0.40 / 0.58 / -30.0%
tpcds_q33/duckdb:vortex-file-compressed 31000396 / 30479240 / +1.7% 57744362 / 58440205 / -1.2% 0.54 / 0.52 / +2.9%
tpcds_q34/duckdb:vortex-file-compressed 25096421 / 24536026 / +2.3% 47040405 / 47841759 / -1.7% 0.53 / 0.51 / +4.0%
tpcds_q35/duckdb:vortex-file-compressed 79544504 / 79557000 / -0.0% 119833768 / 108891302 / +10.0% 🔴 0.66 / 0.73 / -9.1%
tpcds_q36/duckdb:vortex-file-compressed 27248612 / 26867257 / +1.4% 57860552 / 56972571 / +1.6% 0.47 / 0.47 / -0.1%
tpcds_q37/duckdb:vortex-file-compressed 24222288 / 23703256 / +2.2% 53424922 / 56301526 / -5.1% 0.45 / 0.42 / +7.7%
tpcds_q38/duckdb:vortex-file-compressed 39210859 / 38397857 / +2.1% 63203090 / 61566207 / +2.7% 0.62 / 0.62 / -0.5%
tpcds_q39/duckdb:vortex-file-compressed 37274700 / 35691264 / +4.4% 67392256 / 67163610 / +0.3% 0.55 / 0.53 / +4.1%
tpcds_q40/duckdb:vortex-file-compressed 22797946 / 23479890 / -2.9% 41110483 / 35121846 / +17.1% 🔴 0.55 / 0.67 / -17.0%
tpcds_q41/duckdb:vortex-file-compressed 9430018 / 9174433 / +2.8% 20290026 / 19379227 / +4.7% 0.46 / 0.47 / -1.8%
tpcds_q42/duckdb:vortex-file-compressed 16454320 / 16222428 / +1.4% 42359494 / 40588599 / +4.4% 0.39 / 0.40 / -2.8%
tpcds_q43/duckdb:vortex-file-compressed 20363612 / 20971444 / -2.9% 40094525 / 39050227 / +2.7% 0.51 / 0.54 / -5.4%
tpcds_q44/duckdb:vortex-file-compressed 24170069 / 23541615 / +2.7% 64248599 / 64708092 / -0.7% 0.38 / 0.36 / +3.4%
tpcds_q45/duckdb:vortex-file-compressed 36020729 / 35316242 / +2.0% 52798608 / 50076469 / +5.4% 0.68 / 0.71 / -3.3%
tpcds_q46/duckdb:vortex-file-compressed 30243244 / 32387750 / -6.6% 61590454 / 64520570 / -4.5% 0.49 / 0.50 / -2.2%
tpcds_q47/duckdb:vortex-file-compressed 52731014 / 54246188 / -2.8% 82633912 / 82890163 / -0.3% 0.64 / 0.65 / -2.5%
tpcds_q48/duckdb:vortex-file-compressed 35452978 / 34243808 / +3.5% 70661730 / 65497082 / +7.9% 0.50 / 0.52 / -4.0%
tpcds_q49/duckdb:vortex-file-compressed 33609902 / 33200438 / +1.2% 68687596 / 71537516 / -4.0% 0.49 / 0.46 / +5.4%
tpcds_q50/duckdb:vortex-file-compressed 29124916 / 30520564 / -4.6% 57507544 / 60446521 / -4.9% 0.51 / 0.50 / +0.3%
tpcds_q51/duckdb:vortex-file-compressed 131118759 / 95032743 / +38.0% 🔴 124873415 / 123805100 / +0.9% 1.05 / 0.77 / +36.8%
tpcds_q52/duckdb:vortex-file-compressed 16993366 / 16831942 / +1.0% 39708163 / 41963401 / -5.4% 0.43 / 0.40 / +6.7%
tpcds_q53/duckdb:vortex-file-compressed 25148616 / 24487528 / +2.7% 49737216 / 47424316 / +4.9% 0.51 / 0.52 / -2.1%
tpcds_q54/duckdb:vortex-file-compressed 35776197 / 36549513 / -2.1% 69289556 / 74692341 / -7.2% 0.52 / 0.49 / +5.5%
tpcds_q55/duckdb:vortex-file-compressed 16767107 / 16974170 / -1.2% 49982811 / 43180251 / +15.8% 🔴 0.34 / 0.39 / -14.7%
tpcds_q56/duckdb:vortex-file-compressed 31532786 / 30123582 / +4.7% 62615041 / 61758223 / +1.4% 0.50 / 0.49 / +3.2%
tpcds_q57/duckdb:vortex-file-compressed 41812036 / 38801736 / +7.8% 59142659 / 65048763 / -9.1% 0.71 / 0.60 / +18.5%
tpcds_q58/duckdb:vortex-file-compressed 33401588 / 33803666 / -1.2% 57359409 / 58539087 / -2.0% 0.58 / 0.58 / +0.8%
tpcds_q59/duckdb:vortex-file-compressed 37957802 / 37793481 / +0.4% 59352055 / 58437073 / +1.6% 0.64 / 0.65 / -1.1%
tpcds_q60/duckdb:vortex-file-compressed 30922670 / 31050416 / -0.4% 61874881 / 61295183 / +0.9% 0.50 / 0.51 / -1.3%
tpcds_q61/duckdb:vortex-file-compressed 35587803 / 37022555 / -3.9% 82674522 / 78596400 / +5.2% 0.43 / 0.47 / -8.6%
tpcds_q62/duckdb:vortex-file-compressed 18307102 / 18170720 / +0.8% 35388211 / 34756334 / +1.8% 0.52 / 0.52 / -1.0%
tpcds_q63/duckdb:vortex-file-compressed 21851471 / 22684218 / -3.7% 49743008 / 45931308 / +8.3% 0.44 / 0.49 / -11.1%
tpcds_q64/duckdb:vortex-file-compressed 108905100 / 106989796 / +1.8% 149126152 / 145556561 / +2.5% 0.73 / 0.74 / -0.6%
tpcds_q65/duckdb:vortex-file-compressed 24211954 / 26299304 / -7.9% 48451190 / 45029183 / +7.6% 0.50 / 0.58 / -14.4%
tpcds_q66/duckdb:vortex-file-compressed 37566420 / 38635394 / -2.8% 67218491 / 68310225 / -1.6% 0.56 / 0.57 / -1.2%
tpcds_q67/duckdb:vortex-file-compressed 129120968 / 133539357 / -3.3% 151762843 / 161678671 / -6.1% 0.85 / 0.83 / +3.0%
tpcds_q68/duckdb:vortex-file-compressed 33201959 / 29772629 / +11.5% 🔴 64914676 / 67108431 / -3.3% 0.51 / 0.44 / +15.3%
tpcds_q69/duckdb:vortex-file-compressed 52323214 / 49571586 / +5.6% 94596536 / 84206842 / +12.3% 🔴 0.55 / 0.59 / -6.0%
tpcds_q70/duckdb:vortex-file-compressed 35723670 / 34207216 / +4.4% 63793092 / 61721048 / +3.4% 0.56 / 0.55 / +1.0%
tpcds_q71/duckdb:vortex-file-compressed 24077730 / 25696037 / -6.3% 57621185 / 57186650 / +0.8% 0.42 / 0.45 / -7.0%
tpcds_q72/duckdb:vortex-file-compressed 143429077 / 146348920 / -2.0% 188110027 / 192444238 / -2.3% 0.76 / 0.76 / +0.3%
tpcds_q73/duckdb:vortex-file-compressed 24144223 / 24450086 / -1.3% 46698505 / 46484019 / +0.5% 0.52 / 0.53 / -1.7%
tpcds_q74/duckdb:vortex-file-compressed 51135096 / 50163034 / +1.9% 79334766 / 74691262 / +6.2% 0.64 / 0.67 / -4.0%
tpcds_q75/duckdb:vortex-file-compressed 55369588 / 56890676 / -2.7% 87103700 / 86865689 / +0.3% 0.64 / 0.65 / -2.9%
tpcds_q76/duckdb:vortex-file-compressed 24113578 / 23467306 / +2.8% 53528701 / 58496539 / -8.5% 0.45 / 0.40 / +12.3%
tpcds_q77/duckdb:vortex-file-compressed 27979656 / 28086084 / -0.4% 54562179 / 55136912 / -1.0% 0.51 / 0.51 / +0.7%
tpcds_q78/duckdb:vortex-file-compressed 75137857 / 71283263 / +5.4% 100317770 / 104938865 / -4.4% 0.75 / 0.68 / +10.3%
tpcds_q79/duckdb:vortex-file-compressed 27349134 / 27264603 / +0.3% 53533304 / 57015044 / -6.1% 0.51 / 0.48 / +6.8%
tpcds_q80/duckdb:vortex-file-compressed 49092715 / 48981210 / +0.2% 84423983 / 86775209 / -2.7% 0.58 / 0.56 / +3.0%
tpcds_q81/duckdb:vortex-file-compressed 38244922 / 38790537 / -1.4% 61422917 / 61219730 / +0.3% 0.62 / 0.63 / -1.7%
tpcds_q82/duckdb:vortex-file-compressed 56085548 / 53338086 / +5.2% 81536338 / 76160901 / +7.1% 0.69 / 0.70 / -1.8%
tpcds_q83/duckdb:vortex-file-compressed 31076991 / 32374958 / -4.0% 44234187 / 47378557 / -6.6% 0.70 / 0.68 / +2.8%
tpcds_q84/duckdb:vortex-file-compressed 24816650 / 25925222 / -4.3% 43956420 / 37488037 / +17.3% 🔴 0.56 / 0.69 / -18.4%
tpcds_q85/duckdb:vortex-file-compressed 50472760 / 51454975 / -1.9% 72500481 / 70749485 / +2.5% 0.70 / 0.73 / -4.3%
tpcds_q86/duckdb:vortex-file-compressed 18317774 / 18663160 / -1.9% 37907087 / 40241139 / -5.8% 0.48 / 0.46 / +4.2%
tpcds_q87/duckdb:vortex-file-compressed 40939038 / 43810148 / -6.6% 63751876 / 63034226 / +1.1% 0.64 / 0.70 / -7.6%
tpcds_q88/duckdb:vortex-file-compressed 60151710 / 60534922 / -0.6% 116408164 / 122878514 / -5.3% 0.52 / 0.49 / +4.9%
tpcds_q89/duckdb:vortex-file-compressed 23263164 / 25465883 / -8.6% 52391313 / 47980101 / +9.2% 0.44 / 0.53 / -16.3%
tpcds_q90/duckdb:vortex-file-compressed 16816346 / 16449472 / +2.2% 30774575 / 31256698 / -1.5% 0.55 / 0.53 / +3.8%
tpcds_q91/duckdb:vortex-file-compressed 29294497 / 29536684 / -0.8% 46884891 / 43307457 / +8.3% 0.62 / 0.68 / -8.4%
tpcds_q92/duckdb:vortex-file-compressed 21765961 / 20854270 / +4.4% 39840390 / 40426614 / -1.5% 0.55 / 0.52 / +5.9%
tpcds_q93/duckdb:vortex-file-compressed 28238496 / 29213904 / -3.3% 49963049 / 54244028 / -7.9% 0.57 / 0.54 / +4.9%
tpcds_q94/duckdb:vortex-file-compressed 28493548 / 29624510 / -3.8% 50600009 / 47803570 / +5.8% 0.56 / 0.62 / -9.1%
tpcds_q95/duckdb:vortex-file-compressed 144059916 / 141914182 / +1.5% 138165313 / 152034358 / -9.1% 1.04 / 0.93 / +11.7%
tpcds_q96/duckdb:vortex-file-compressed 15748186 / 16772659 / -6.1% 34213268 / 41844568 / -18.2% 🟢 0.46 / 0.40 / +14.8%
tpcds_q97/duckdb:vortex-file-compressed 39180097 / 39249850 / -0.2% 59418815 / 62879758 / -5.5% 0.66 / 0.62 / +5.6%
tpcds_q98/duckdb:vortex-file-compressed 23818937 / 22949566 / +3.8% 46727157 / 45101825 / +3.6% 0.51 / 0.51 / +0.2%
tpcds_q99/duckdb:vortex-file-compressed 26574332 / 24546174 / +8.3% 45684730 / 39795874 / +14.8% 🔴 0.58 / 0.62 / -5.7%
duckdb / parquet / ns (0.992x ➖, 9↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 31891151 / 31013940 / +2.8% 47102037 / 46393378 / +1.5% 0.68 / 0.67 / +1.3%
tpcds_q02/duckdb:parquet 28017157 / 21736008 / +28.9% 🔴 32909737 / 39733057 / -17.2% 🟢 0.85 / 0.55 / +55.6%
tpcds_q03/duckdb:parquet 13049894 / 14221273 / -8.2% 23621351 / 23023494 / +2.6% 0.55 / 0.62 / -10.6%
tpcds_q04/duckdb:parquet 194473772 / 194893660 / -0.2% 204764620 / 198919921 / +2.9% 0.95 / 0.98 / -3.1%
tpcds_q05/duckdb:parquet 32835879 / 32744162 / +0.3% 43195286 / 42794143 / +0.9% 0.76 / 0.77 / -0.7%
tpcds_q06/duckdb:parquet 36123118 / 35531792 / +1.7% 55026952 / 54822314 / +0.4% 0.66 / 0.65 / +1.3%
tpcds_q07/duckdb:parquet 22516032 / 21848722 / +3.1% 36356450 / 36320748 / +0.1% 0.62 / 0.60 / +3.0%
tpcds_q08/duckdb:parquet 33366980 / 34457484 / -3.2% 46686396 / 45139219 / +3.4% 0.71 / 0.76 / -6.4%
tpcds_q09/duckdb:parquet 31283670 / 31654792 / -1.2% 38480362 / 44274087 / -13.1% 🟢 0.81 / 0.71 / +13.7%
tpcds_q10/duckdb:parquet 40698562 / 40812168 / -0.3% 57008173 / 59659452 / -4.4% 0.71 / 0.68 / +4.4%
tpcds_q11/duckdb:parquet 102641469 / 103618494 / -0.9% 116160874 / 120311916 / -3.5% 0.88 / 0.86 / +2.6%
tpcds_q12/duckdb:parquet 19983104 / 17654684 / +13.2% 🔴 27356214 / 26789928 / +2.1% 0.73 / 0.66 / +10.8%
tpcds_q13/duckdb:parquet 35436428 / 40459398 / -12.4% 🟢 52746143 / 54497327 / -3.2% 0.67 / 0.74 / -9.5%
tpcds_q14/duckdb:parquet 104886871 / 105386879 / -0.5% 119616651 / 112602785 / +6.2% 0.88 / 0.94 / -6.3%
tpcds_q15/duckdb:parquet 36002264 / 35466131 / +1.5% 50739756 / 48500128 / +4.6% 0.71 / 0.73 / -3.0%
tpcds_q16/duckdb:parquet 28201984 / 27395959 / +2.9% 42364999 / 42638567 / -0.6% 0.67 / 0.64 / +3.6%
tpcds_q17/duckdb:parquet 44883868 / 44185986 / +1.6% 59359613 / 57918631 / +2.5% 0.76 / 0.76 / -0.9%
tpcds_q18/duckdb:parquet 56468798 / 56283554 / +0.3% 76677610 / 76790499 / -0.1% 0.74 / 0.73 / +0.5%
tpcds_q19/duckdb:parquet 34591288 / 33075318 / +4.6% 47778230 / 45629879 / +4.7% 0.72 / 0.72 / -0.1%
tpcds_q20/duckdb:parquet 19241486 / 19784768 / -2.7% 28745493 / 28389598 / +1.3% 0.67 / 0.70 / -4.0%
tpcds_q21/duckdb:parquet 13871004 / 14659077 / -5.4% 24887221 / 22985127 / +8.3% 0.56 / 0.64 / -12.6%
tpcds_q22/duckdb:parquet 52392368 / 67132198 / -22.0% 🟢 79647558 / 73494999 / +8.4% 0.66 / 0.91 / -28.0%
tpcds_q23/duckdb:parquet 67578570 / 67136014 / +0.7% 86000241 / 85962885 / +0.0% 0.79 / 0.78 / +0.6%
tpcds_q24/duckdb:parquet 49107592 / 49021900 / +0.2% 70873247 / 75551707 / -6.2% 0.69 / 0.65 / +6.8%
tpcds_q25/duckdb:parquet 44559086 / 42214428 / +5.6% 57617715 / 60276028 / -4.4% 0.77 / 0.70 / +10.4%
tpcds_q26/duckdb:parquet 45445477 / 43415644 / +4.7% 57352586 / 55989558 / +2.4% 0.79 / 0.78 / +2.2%
tpcds_q27/duckdb:parquet 56153592 / 54255098 / +3.5% 72739504 / 70325979 / +3.4% 0.77 / 0.77 / +0.1%
tpcds_q28/duckdb:parquet 29076942 / 28829658 / +0.9% 38033435 / 38223239 / -0.5% 0.76 / 0.75 / +1.4%
tpcds_q29/duckdb:parquet 42568552 / 42615476 / -0.1% 60788548 / 57762442 / +5.2% 0.70 / 0.74 / -5.1%
tpcds_q30/duckdb:parquet 43469986 / 44652342 / -2.6% 62581400 / 59257211 / +5.6% 0.69 / 0.75 / -7.8%
tpcds_q31/duckdb:parquet 30471328 / 28924658 / +5.3% 42945847 / 41401697 / +3.7% 0.71 / 0.70 / +1.6%
tpcds_q32/duckdb:parquet 15158829 / 15602963 / -2.8% 27186813 / 26259505 / +3.5% 0.56 / 0.59 / -6.2%
tpcds_q33/duckdb:parquet 24092850 / 23172790 / +4.0% 40534406 / 38604201 / +5.0% 0.59 / 0.60 / -1.0%
tpcds_q34/duckdb:parquet 21461032 / 23484880 / -8.6% 35057705 / 37630198 / -6.8% 0.61 / 0.62 / -1.9%
tpcds_q35/duckdb:parquet 68738150 / 67334732 / +2.1% 87172570 / 84752729 / +2.9% 0.79 / 0.79 / -0.7%
tpcds_q36/duckdb:parquet 22604566 / 22416600 / +0.8% 38664122 / 43294390 / -10.7% 🟢 0.58 / 0.52 / +12.9%
tpcds_q37/duckdb:parquet 18165716 / 20835232 / -12.8% 🟢 30200908 / 30443330 / -0.8% 0.60 / 0.68 / -12.1%
tpcds_q38/duckdb:parquet 40739234 / 40504744 / +0.6% 48813930 / 52776841 / -7.5% 0.83 / 0.77 / +8.7%
tpcds_q39/duckdb:parquet 36915656 / 38039336 / -3.0% 47482237 / 64375754 / -26.2% 🟢 0.78 / 0.59 / +31.6%
tpcds_q40/duckdb:parquet 22210746 / 22687332 / -2.1% 32345924 / 32006025 / +1.1% 0.69 / 0.71 / -3.1%
tpcds_q41/duckdb:parquet 10434710 / 10922401 / -4.5% 22144130 / 20953924 / +5.7% 0.47 / 0.52 / -9.6%
tpcds_q42/duckdb:parquet 13041199 / 11785812 / +10.7% 🔴 22480327 / 22236381 / +1.1% 0.58 / 0.53 / +9.5%
tpcds_q43/duckdb:parquet 14910763 / 19113492 / -22.0% 🟢 25710109 / 31095951 / -17.3% 🟢 0.58 / 0.61 / -5.6%
tpcds_q44/duckdb:parquet 24933553 / 25281088 / -1.4% 39411372 / 39004086 / +1.0% 0.63 / 0.65 / -2.4%
tpcds_q45/duckdb:parquet 32423148 / 31792328 / +2.0% 42906942 / 43514991 / -1.4% 0.76 / 0.73 / +3.4%
tpcds_q46/duckdb:parquet 49202996 / 50327579 / -2.2% 69806584 / 68708921 / +1.6% 0.70 / 0.73 / -3.8%
tpcds_q47/duckdb:parquet 51520517 / 47773928 / +7.8% 67604381 / 64624081 / +4.6% 0.76 / 0.74 / +3.1%
tpcds_q48/duckdb:parquet 31506762 / 30099491 / +4.7% 50318744 / 50001559 / +0.6% 0.63 / 0.60 / +4.0%
tpcds_q49/duckdb:parquet 28228168 / 27835777 / +1.4% 43583666 / 42505337 / +2.5% 0.65 / 0.65 / -1.1%
tpcds_q50/duckdb:parquet 25102090 / 25266530 / -0.7% 39854347 / 37657715 / +5.8% 0.63 / 0.67 / -6.1%
tpcds_q51/duckdb:parquet 95106070 / 94533254 / +0.6% 113264505 / 144365978 / -21.5% 🟢 0.84 / 0.65 / +28.2%
tpcds_q52/duckdb:parquet 12149200 / 11903590 / +2.1% 22347260 / 24043988 / -7.1% 0.54 / 0.50 / +9.8%
tpcds_q53/duckdb:parquet 16191656 / 16109201 / +0.5% 29317293 / 29254656 / +0.2% 0.55 / 0.55 / +0.3%
tpcds_q54/duckdb:parquet 30747644 / 30328670 / +1.4% 43998189 / 44802705 / -1.8% 0.70 / 0.68 / +3.2%
tpcds_q55/duckdb:parquet 13432210 / 11937859 / +12.5% 🔴 25639872 / 21774428 / +17.8% 🔴 0.52 / 0.55 / -4.4%
tpcds_q56/duckdb:parquet 24272511 / 24760701 / -2.0% 43230415 / 39485470 / +9.5% 0.56 / 0.63 / -10.5%
tpcds_q57/duckdb:parquet 43581380 / 44536856 / -2.1% 67248917 / 55269111 / +21.7% 🔴 0.65 / 0.81 / -19.6%
tpcds_q58/duckdb:parquet 27986262 / 28384995 / -1.4% 41054304 / 40089413 / +2.4% 0.68 / 0.71 / -3.7%
tpcds_q59/duckdb:parquet 30757364 / 30637812 / +0.4% 41245405 / 53568447 / -23.0% 🟢 0.75 / 0.57 / +30.4%
tpcds_q60/duckdb:parquet 25964014 / 25486830 / +1.9% 39332191 / 40137459 / -2.0% 0.66 / 0.63 / +4.0%
tpcds_q61/duckdb:parquet 33942697 / 32003979 / +6.1% 45573461 / 45178850 / +0.9% 0.74 / 0.71 / +5.1%
tpcds_q62/duckdb:parquet 15437102 / 14866462 / +3.8% 23034626 / 24056403 / -4.2% 0.67 / 0.62 / +8.4%
tpcds_q63/duckdb:parquet 15525056 / 17739640 / -12.5% 🟢 28558319 / 28778640 / -0.8% 0.54 / 0.62 / -11.8%
tpcds_q64/duckdb:parquet 78793808 / 81216987 / -3.0% 105240465 / 105110119 / +0.1% 0.75 / 0.77 / -3.1%
tpcds_q65/duckdb:parquet 23185315 / 23134724 / +0.2% 37265770 / 37391961 / -0.3% 0.62 / 0.62 / +0.6%
tpcds_q66/duckdb:parquet 35592260 / 35488600 / +0.3% 47500123 / 49513104 / -4.1% 0.75 / 0.72 / +4.5%
tpcds_q67/duckdb:parquet 122463728 / 126514872 / -3.2% 153255434 / 140567909 / +9.0% 0.80 / 0.90 / -11.2%
tpcds_q68/duckdb:parquet 38900378 / 44107896 / -11.8% 🟢 59167222 / 62443904 / -5.2% 0.66 / 0.71 / -6.9%
tpcds_q69/duckdb:parquet 41975920 / 41309325 / +1.6% 61851553 / 59709891 / +3.6% 0.68 / 0.69 / -1.9%
tpcds_q70/duckdb:parquet 30015780 / 28894024 / +3.9% 47201953 / 48445554 / -2.6% 0.64 / 0.60 / +6.6%
tpcds_q71/duckdb:parquet 21362053 / 21666240 / -1.4% 36087096 / 34800225 / +3.7% 0.59 / 0.62 / -4.9%
tpcds_q72/duckdb:parquet 185363621 / 171583881 / +8.0% 133180992 / 200461318 / -33.6% 🟢 1.39 / 0.86 / +62.6%
tpcds_q73/duckdb:parquet 19622015 / 21479664 / -8.6% 31399124 / 32763168 / -4.2% 0.62 / 0.66 / -4.7%
tpcds_q74/duckdb:parquet 144737728 / 145210136 / -0.3% 163572774 / 161006849 / +1.6% 0.88 / 0.90 / -1.9%
tpcds_q75/duckdb:parquet 60237556 / 60526026 / -0.5% 79785204 / 79549314 / +0.3% 0.75 / 0.76 / -0.8%
tpcds_q76/duckdb:parquet 19416637 / 20673622 / -6.1% 33622827 / 31897250 / +5.4% 0.58 / 0.65 / -10.9%
tpcds_q77/duckdb:parquet 24690170 / 26389853 / -6.4% 39662599 / 40446333 / -1.9% 0.62 / 0.65 / -4.6%
tpcds_q78/duckdb:parquet 77930262 / 76936433 / +1.3% 91099949 / 93417019 / -2.5% 0.86 / 0.82 / +3.9%
tpcds_q79/duckdb:parquet 27888246 / 27878510 / +0.0% 43618484 / 43149464 / +1.1% 0.64 / 0.65 / -1.0%
tpcds_q80/duckdb:parquet 47865902 / 49562456 / -3.4% 63451464 / 61056742 / +3.9% 0.75 / 0.81 / -7.1%
tpcds_q81/duckdb:parquet 40953820 / 40959882 / -0.0% 58658409 / 57007200 / +2.9% 0.70 / 0.72 / -2.8%
tpcds_q82/duckdb:parquet 19529696 / 20655708 / -5.5% 33043027 / 32599493 / +1.4% 0.59 / 0.63 / -6.7%
tpcds_q83/duckdb:parquet 22417932 / 22490606 / -0.3% 33632054 / 33010430 / +1.9% 0.67 / 0.68 / -2.2%
tpcds_q84/duckdb:parquet 24296162 / 23979717 / +1.3% 34121243 / 34845245 / -2.1% 0.71 / 0.69 / +3.5%
tpcds_q85/duckdb:parquet 49400441 / 48636374 / +1.6% 67113960 / 68548465 / -2.1% 0.74 / 0.71 / +3.7%
tpcds_q86/duckdb:parquet 15271220 / 15285832 / -0.1% 27372490 / 25409617 / +7.7% 0.56 / 0.60 / -7.3%
tpcds_q87/duckdb:parquet 44825909 / 44210160 / +1.4% 53095902 / 55417637 / -4.2% 0.84 / 0.80 / +5.8%
tpcds_q88/duckdb:parquet 43860451 / 42978822 / +2.1% 52999424 / 52427454 / +1.1% 0.83 / 0.82 / +0.9%
tpcds_q89/duckdb:parquet 18065880 / 20445187 / -11.6% 🟢 31838317 / 36362897 / -12.4% 🟢 0.57 / 0.56 / +0.9%
tpcds_q90/duckdb:parquet 10215726 / 10403743 / -1.8% 21971302 / 20775864 / +5.8% 0.46 / 0.50 / -7.1%
tpcds_q91/duckdb:parquet 27113130 / 27474552 / -1.3% 41991878 / 43524306 / -3.5% 0.65 / 0.63 / +2.3%
tpcds_q92/duckdb:parquet 15984345 / 15884266 / +0.6% 27143760 / 27384118 / -0.9% 0.59 / 0.58 / +1.5%
tpcds_q93/duckdb:parquet 30650708 / 35388695 / -13.4% 🟢 48309457 / 49814708 / -3.0% 0.63 / 0.71 / -10.7%
tpcds_q94/duckdb:parquet 22103860 / 21858083 / +1.1% 35761831 / 38944367 / -8.2% 0.62 / 0.56 / +10.1%
tpcds_q95/duckdb:parquet 139507042 / 136550708 / +2.2% 152414477 / 152426570 / -0.0% 0.92 / 0.90 / +2.2%
tpcds_q96/duckdb:parquet 9812552 / 11312938 / -13.3% 🟢 17883509 / 18121937 / -1.3% 0.55 / 0.62 / -12.1%
tpcds_q97/duckdb:parquet 39614266 / 39755624 / -0.4% 49765071 / 52117216 / -4.5% 0.80 / 0.76 / +4.4%
tpcds_q98/duckdb:parquet 22148810 / 21756784 / +1.8% 36590791 / 34940856 / +4.7% 0.61 / 0.62 / -2.8%
tpcds_q99/duckdb:parquet 23979336 / 23771298 / +0.9% 32874585 / 33655067 / -2.3% 0.73 / 0.71 / +3.3%

No file size changes detected.

@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR ff9eddd4 vs base 68e2aee0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.5%, low confidence) · DuckDB No clear signal (-0.1%, low confidence)
Vortex (geomean): hot 1.000x ➖ · cold 1.001x ➖
Parquet (geomean): hot 0.998x ➖ · cold 1.013x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 350605045 / 331600132 / +5.7% 502170452 / 449330003 / +11.8% 🔴 0.70 / 0.74 / -5.4%
tpch_q02/datafusion:vortex-file-compressed 95652464 / 97094752 / -1.5% 182132546 / 176885053 / +3.0% 0.53 / 0.55 / -4.3%
tpch_q03/datafusion:vortex-file-compressed 138129483 / 138307390 / -0.1% 287736640 / 283974022 / +1.3% 0.48 / 0.49 / -1.4%
tpch_q04/datafusion:vortex-file-compressed 58101029 / 57609724 / +0.9% 130715135 / 130841906 / -0.1% 0.44 / 0.44 / +1.0%
tpch_q05/datafusion:vortex-file-compressed 265063364 / 266199115 / -0.4% 408253732 / 412752726 / -1.1% 0.65 / 0.64 / +0.7%
tpch_q06/datafusion:vortex-file-compressed 23346855 / 23302721 / +0.2% 155787797 / 132826288 / +17.3% 🔴 0.15 / 0.18 / -14.6%
tpch_q07/datafusion:vortex-file-compressed 350208812 / 349082007 / +0.3% 496025928 / 496445869 / -0.1% 0.71 / 0.70 / +0.4%
tpch_q08/datafusion:vortex-file-compressed 265002401 / 268896235 / -1.4% 482300759 / 487976204 / -1.2% 0.55 / 0.55 / -0.3%
tpch_q09/datafusion:vortex-file-compressed 461997857 / 484327657 / -4.6% 624936990 / 710895882 / -12.1% 🟢 0.74 / 0.68 / +8.5%
tpch_q10/datafusion:vortex-file-compressed 160583655 / 161011357 / -0.3% 303468870 / 298701606 / +1.6% 0.53 / 0.54 / -1.8%
tpch_q11/datafusion:vortex-file-compressed 68478429 / 68765143 / -0.4% 132203578 / 136694098 / -3.3% 0.52 / 0.50 / +3.0%
tpch_q12/datafusion:vortex-file-compressed 79439733 / 79690084 / -0.3% 165458713 / 174917329 / -5.4% 0.48 / 0.46 / +5.4%
tpch_q13/datafusion:vortex-file-compressed 115536930 / 115715854 / -0.2% 193061623 / 194796158 / -0.9% 0.60 / 0.59 / +0.7%
tpch_q14/datafusion:vortex-file-compressed 37916442 / 37466096 / +1.2% 172248978 / 172717727 / -0.3% 0.22 / 0.22 / +1.5%
tpch_q15/datafusion:vortex-file-compressed 67232455 / 66658714 / +0.9% 194449042 / 191669217 / +1.5% 0.35 / 0.35 / -0.6%
tpch_q16/datafusion:vortex-file-compressed 59947430 / 59985935 / -0.1% 139925429 / 140273193 / -0.2% 0.43 / 0.43 / +0.2%
tpch_q17/datafusion:vortex-file-compressed 410373896 / 402476350 / +2.0% 498097596 / 532709167 / -6.5% 0.82 / 0.76 / +9.0%
tpch_q18/datafusion:vortex-file-compressed 590496939 / 611141094 / -3.4% 783597767 / 772024680 / +1.5% 0.75 / 0.79 / -4.8%
tpch_q19/datafusion:vortex-file-compressed 53163256 / 53400702 / -0.4% 180315730 / 176315887 / +2.3% 0.29 / 0.30 / -2.7%
tpch_q20/datafusion:vortex-file-compressed 123415647 / 124056814 / -0.5% 260523283 / 260152613 / +0.1% 0.47 / 0.48 / -0.7%
tpch_q21/datafusion:vortex-file-compressed 441191169 / 427275588 / +3.3% 558775711 / 539246872 / +3.6% 0.79 / 0.79 / -0.4%
tpch_q22/datafusion:vortex-file-compressed 36201048 / 36862570 / -1.8% 98977621 / 97967985 / +1.0% 0.37 / 0.38 / -2.8%
datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 322102769 / 322785384 / -0.2% 403174006 / 410123587 / -1.7% 0.80 / 0.79 / +1.5%
tpch_q02/datafusion:parquet 181204097 / 181065181 / +0.1% 254980517 / 269017785 / -5.2% 0.71 / 0.67 / +5.6%
tpch_q03/datafusion:parquet 209451852 / 213434473 / -1.9% 351582469 / 358667141 / -2.0% 0.60 / 0.60 / +0.1%
tpch_q04/datafusion:parquet 88264503 / 89313265 / -1.2% 187486869 / 180301778 / +4.0% 0.47 / 0.50 / -5.0%
tpch_q05/datafusion:parquet 338890828 / 340951976 / -0.6% 518692474 / 505411846 / +2.6% 0.65 / 0.67 / -3.1%
tpch_q06/datafusion:parquet 69095545 / 67161867 / +2.9% 162464188 / 164428854 / -1.2% 0.43 / 0.41 / +4.1%
tpch_q07/datafusion:parquet 485034959 / 483674705 / +0.3% 665715515 / 655920088 / +1.5% 0.73 / 0.74 / -1.2%
tpch_q08/datafusion:parquet 377138178 / 373247689 / +1.0% 542753552 / 546768197 / -0.7% 0.69 / 0.68 / +1.8%
tpch_q09/datafusion:parquet 645925262 / 643881909 / +0.3% 830628907 / 831245064 / -0.1% 0.78 / 0.77 / +0.4%
tpch_q10/datafusion:parquet 509694441 / 518532584 / -1.7% 683543614 / 686744515 / -0.5% 0.75 / 0.76 / -1.2%
tpch_q11/datafusion:parquet 126928383 / 130036432 / -2.4% 207821825 / 177605204 / +17.0% 🔴 0.61 / 0.73 / -16.6%
tpch_q12/datafusion:parquet 139197415 / 138487519 / +0.5% 247617755 / 244367813 / +1.3% 0.56 / 0.57 / -0.8%
tpch_q13/datafusion:parquet 333786681 / 331857217 / +0.6% 416311568 / 397087504 / +4.8% 0.80 / 0.84 / -4.1%
tpch_q14/datafusion:parquet 109906404 / 120291774 / -8.6% 234975547 / 237951964 / -1.3% 0.47 / 0.51 / -7.5%
tpch_q15/datafusion:parquet 185395285 / 186146690 / -0.4% 287136570 / 283865827 / +1.2% 0.65 / 0.66 / -1.5%
tpch_q16/datafusion:parquet 121198059 / 121156040 / +0.0% 193764757 / 202263894 / -4.2% 0.63 / 0.60 / +4.4%
tpch_q17/datafusion:parquet 443483421 / 444930856 / -0.3% 565240632 / 563801708 / +0.3% 0.78 / 0.79 / -0.6%
tpch_q18/datafusion:parquet 674719259 / 673350661 / +0.2% 846720638 / 847265331 / -0.1% 0.80 / 0.79 / +0.3%
tpch_q19/datafusion:parquet 179633354 / 179705162 / -0.0% 306973157 / 308359693 / -0.4% 0.59 / 0.58 / +0.4%
tpch_q20/datafusion:parquet 270035487 / 271134635 / -0.4% 400791316 / 390745047 / +2.6% 0.67 / 0.69 / -2.9%
tpch_q21/datafusion:parquet 557368484 / 557356061 / +0.0% 787159420 / 784319218 / +0.4% 0.71 / 0.71 / -0.4%
tpch_q22/datafusion:parquet 224183233 / 223580984 / +0.3% 278406848 / 284612193 / -2.2% 0.81 / 0.79 / +2.5%
duckdb / vortex-file-compressed / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 100620449 / 99100800 / +1.5% 192030489 / 204901953 / -6.3% 0.52 / 0.48 / +8.3%
tpch_q02/duckdb:vortex-file-compressed 64826616 / 68877201 / -5.9% 110651179 / 113377260 / -2.4% 0.59 / 0.61 / -3.6%
tpch_q03/duckdb:vortex-file-compressed 126251549 / 129196214 / -2.3% 229023252 / 243559510 / -6.0% 0.55 / 0.53 / +3.9%
tpch_q04/duckdb:vortex-file-compressed 159988898 / 160347806 / -0.2% 237264611 / 242194984 / -2.0% 0.67 / 0.66 / +1.8%
tpch_q05/duckdb:vortex-file-compressed 141980662 / 143432568 / -1.0% 264402425 / 253239348 / +4.4% 0.54 / 0.57 / -5.2%
tpch_q06/duckdb:vortex-file-compressed 38245408 / 37224684 / +2.7% 134568543 / 131041677 / +2.7% 0.28 / 0.28 / +0.0%
tpch_q07/duckdb:vortex-file-compressed 120642707 / 122113499 / -1.2% 270372730 / 264078495 / +2.4% 0.45 / 0.46 / -3.5%
tpch_q08/duckdb:vortex-file-compressed 171346953 / 175664804 / -2.5% 281983142 / 285638337 / -1.3% 0.61 / 0.61 / -1.2%
tpch_q09/duckdb:vortex-file-compressed 304015907 / 308753097 / -1.5% 441595696 / 436517175 / +1.2% 0.69 / 0.71 / -2.7%
tpch_q10/duckdb:vortex-file-compressed 211357834 / 208084295 / +1.6% 375404624 / 373550863 / +0.5% 0.56 / 0.56 / +1.1%
tpch_q11/duckdb:vortex-file-compressed 39618715 / 39052680 / +1.4% 89314854 / 91061016 / -1.9% 0.44 / 0.43 / +3.4%
tpch_q12/duckdb:vortex-file-compressed 109354425 / 111211520 / -1.7% 196968301 / 190991008 / +3.1% 0.56 / 0.58 / -4.7%
tpch_q13/duckdb:vortex-file-compressed 196800116 / 195147087 / +0.8% 290282763 / 292219337 / -0.7% 0.68 / 0.67 / +1.5%
tpch_q14/duckdb:vortex-file-compressed 55037754 / 54047163 / +1.8% 169657063 / 163656314 / +3.7% 0.32 / 0.33 / -1.8%
tpch_q15/duckdb:vortex-file-compressed 77653838 / 75889180 / +2.3% 192191926 / 184451839 / +4.2% 0.40 / 0.41 / -1.8%
tpch_q16/duckdb:vortex-file-compressed 85915495 / 83832299 / +2.5% 125649760 / 123322844 / +1.9% 0.68 / 0.68 / +0.6%
tpch_q17/duckdb:vortex-file-compressed 106846891 / 106281270 / +0.5% 234060326 / 254947028 / -8.2% 0.46 / 0.42 / +9.5%
tpch_q18/duckdb:vortex-file-compressed 265652208 / 254247515 / +4.5% 346036781 / 342476911 / +1.0% 0.77 / 0.74 / +3.4%
tpch_q19/duckdb:vortex-file-compressed 84565970 / 85972716 / -1.6% 211813176 / 200017059 / +5.9% 0.40 / 0.43 / -7.1%
tpch_q20/duckdb:vortex-file-compressed 133439083 / 132228435 / +0.9% 258776232 / 254880768 / +1.5% 0.52 / 0.52 / -0.6%
tpch_q21/duckdb:vortex-file-compressed 482455071 / 476440675 / +1.3% 554190888 / 541079675 / +2.4% 0.87 / 0.88 / -1.1%
tpch_q22/duckdb:vortex-file-compressed 72094052 / 74109427 / -2.7% 123460289 / 136242445 / -9.4% 0.58 / 0.54 / +7.4%
duckdb / parquet / ns (1.001x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 151593553 / 144474777 / +4.9% 196015604 / 194737145 / +0.7% 0.77 / 0.74 / +4.2%
tpch_q02/duckdb:parquet 99736208 / 99657706 / +0.1% 122989187 / 115426452 / +6.6% 0.81 / 0.86 / -6.1%
tpch_q03/duckdb:parquet 166820281 / 167177192 / -0.2% 231871969 / 222834328 / +4.1% 0.72 / 0.75 / -4.1%
tpch_q04/duckdb:parquet 116123261 / 117407085 / -1.1% 164086793 / 154434378 / +6.3% 0.71 / 0.76 / -6.9%
tpch_q05/duckdb:parquet 183968793 / 185416991 / -0.8% 254988272 / 262038365 / -2.7% 0.72 / 0.71 / +2.0%
tpch_q06/duckdb:parquet 54954152 / 56843417 / -3.3% 94342324 / 94521206 / -0.2% 0.58 / 0.60 / -3.1%
tpch_q07/duckdb:parquet 144153334 / 141144733 / +2.1% 223503624 / 237475962 / -5.9% 0.64 / 0.59 / +8.5%
tpch_q08/duckdb:parquet 219229645 / 216965588 / +1.0% 297079116 / 302775105 / -1.9% 0.74 / 0.72 / +3.0%
tpch_q09/duckdb:parquet 344944027 / 349070524 / -1.2% 430200817 / 429906648 / +0.1% 0.80 / 0.81 / -1.2%
tpch_q10/duckdb:parquet 652368227 / 653006394 / -0.1% 846119718 / 731305255 / +15.7% 🔴 0.77 / 0.89 / -13.7%
tpch_q11/duckdb:parquet 41498597 / 42282638 / -1.9% 53724322 / 54234426 / -0.9% 0.77 / 0.78 / -0.9%
tpch_q12/duckdb:parquet 118337636 / 121652604 / -2.7% 154644326 / 149086850 / +3.7% 0.77 / 0.82 / -6.2%
tpch_q13/duckdb:parquet 396750027 / 398725583 / -0.5% 426921256 / 423628748 / +0.8% 0.93 / 0.94 / -1.3%
tpch_q14/duckdb:parquet 153076984 / 152133264 / +0.6% 221628984 / 229460953 / -3.4% 0.69 / 0.66 / +4.2%
tpch_q15/duckdb:parquet 77567481 / 73811577 / +5.1% 129889255 / 120551096 / +7.7% 0.60 / 0.61 / -2.5%
tpch_q16/duckdb:parquet 154735198 / 155657709 / -0.6% 174872552 / 202388079 / -13.6% 🟢 0.88 / 0.77 / +15.0%
tpch_q17/duckdb:parquet 113651688 / 119524779 / -4.9% 203134443 / 193467586 / +5.0% 0.56 / 0.62 / -9.4%
tpch_q18/duckdb:parquet 322249935 / 287879659 / +11.9% 🔴 309852391 / 278343358 / +11.3% 🔴 1.04 / 1.03 / +0.6%
tpch_q19/duckdb:parquet 226514188 / 238761287 / -5.1% 308713786 / 297542079 / +3.8% 0.73 / 0.80 / -8.6%
tpch_q20/duckdb:parquet 199204803 / 198509655 / +0.4% 287081909 / 267768844 / +7.2% 0.69 / 0.74 / -6.4%
tpch_q21/duckdb:parquet 435839206 / 434020456 / +0.4% 481986047 / 468679185 / +2.8% 0.90 / 0.93 / -2.4%
tpch_q22/duckdb:parquet 334388280 / 337670828 / -1.0% 359415707 / 359550332 / -0.0% 0.93 / 0.94 / -0.9%

No file size changes detected.

@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb S3 📖

Commits: PR ff9eddd4 vs base 68e2aee0
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.4%
Engines: DataFusion No clear signal (+16.1%, environment too noisy confidence) · DuckDB No clear signal (-11.4%, environment too noisy confidence)
Vortex (geomean): hot 1.017x ➖ · cold 1.008x ➖
Parquet (geomean): hot 1.003x ➖ · cold 0.948x ➖
Shifts: Parquet (control) +0.3% · Median polish -3.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.059x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 71091856 / 36548954 / +94.5% 🔴 203968980 / 196680022 / +3.7% 0.35 / 0.19 / +87.6%
fineweb_q01/datafusion:vortex-file-compressed 373306180 / 486024046 / -23.2% 857407094 / 1045079288 / -18.0% 0.44 / 0.47 / -6.4%
fineweb_q02/datafusion:vortex-file-compressed 451573746 / 467271290 / -3.4% 445771195 / 425497310 / +4.8% 1.01 / 1.10 / -7.8%
fineweb_q03/datafusion:vortex-file-compressed 571940204 / 463824143 / +23.3% 2505235980 / 884358072 / +183.3% 🔴 0.23 / 0.52 / -56.5%
fineweb_q04/datafusion:vortex-file-compressed 584116716 / 635186486 / -8.0% 460792932 / 550936213 / -16.4% 1.27 / 1.15 / +9.9%
fineweb_q05/datafusion:vortex-file-compressed 589836352 / 594932797 / -0.9% 432309847 / 629798025 / -31.4% 🟢 1.36 / 0.94 / +44.4%
fineweb_q06/datafusion:vortex-file-compressed 674455236 / 682025172 / -1.1% 657607818 / 675933204 / -2.7% 1.03 / 1.01 / +1.6%
fineweb_q07/datafusion:vortex-file-compressed 448824820 / 465513810 / -3.6% 444675976 / 467282159 / -4.8% 1.01 / 1.00 / +1.3%
fineweb_q08/datafusion:vortex-file-compressed 217902050 / 201976295 / +7.9% 222055536 / 216439874 / +2.6% 0.98 / 0.93 / +5.2%
datafusion / parquet / ns (0.912x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 487557932 / 529116416 / -7.9% 977494886 / 953851036 / +2.5% 0.50 / 0.55 / -10.1%
fineweb_q01/datafusion:parquet 801834948 / 847834863 / -5.4% 830015413 / 944423433 / -12.1% 0.97 / 0.90 / +7.6%
fineweb_q02/datafusion:parquet 828972873 / 943894522 / -12.2% 884647123 / 977139676 / -9.5% 0.94 / 0.97 / -3.0%
fineweb_q03/datafusion:parquet 839213254 / 1021595057 / -17.9% 1044057756 / 1140305425 / -8.4% 0.80 / 0.90 / -10.3%
fineweb_q04/datafusion:parquet 887149415 / 903886380 / -1.9% 897978900 / 1020494420 / -12.0% 0.99 / 0.89 / +11.5%
fineweb_q05/datafusion:parquet 912473169 / 910366873 / +0.2% 855784572 / 1201446679 / -28.8% 1.07 / 0.76 / +40.7%
fineweb_q06/datafusion:parquet 975964838 / 880916130 / +10.8% 1061915307 / 885774161 / +19.9% 0.92 / 0.99 / -7.6%
fineweb_q07/datafusion:parquet 855334406 / 1092121336 / -21.7% 855653787 / 1081314550 / -20.9% 1.00 / 1.01 / -1.0%
fineweb_q08/datafusion:parquet 857522024 / 1055105839 / -18.7% 853816917 / 1056414887 / -19.2% 1.00 / 1.00 / +0.6%
duckdb / vortex-file-compressed / ns (0.977x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 65548976 / 67377938 / -2.7% 72391543 / 65049962 / +11.3% 0.91 / 1.04 / -12.6%
fineweb_q01/duckdb:vortex-file-compressed 519177730 / 552420202 / -6.0% 917548737 / 672998181 / +36.3% 🔴 0.57 / 0.82 / -31.1%
fineweb_q02/duckdb:vortex-file-compressed 676667110 / 693193124 / -2.4% 770311872 / 772668647 / -0.3% 0.88 / 0.90 / -2.1%
fineweb_q03/duckdb:vortex-file-compressed 1465062870 / 1438407060 / +1.9% 1681479105 / 1851390751 / -9.2% 0.87 / 0.78 / +12.1%
fineweb_q04/duckdb:vortex-file-compressed 1624473157 / 1687106102 / -3.7% 1627514524 / 1695899557 / -4.0% 1.00 / 0.99 / +0.3%
fineweb_q05/duckdb:vortex-file-compressed 1535957778 / 1633928330 / -6.0% 1514538441 / 1541443107 / -1.7% 1.01 / 1.06 / -4.3%
fineweb_q06/duckdb:vortex-file-compressed 1664335606 / 1786539250 / -6.8% 1628813225 / 1722927879 / -5.5% 1.02 / 1.04 / -1.5%
fineweb_q07/duckdb:vortex-file-compressed 1549878573 / 1554867516 / -0.3% 1459952069 / 2096785097 / -30.4% 🟢 1.06 / 0.74 / +43.2%
fineweb_q08/duckdb:vortex-file-compressed 663026396 / 626805022 / +5.8% 685425117 / 698333697 / -1.8% 0.97 / 0.90 / +7.8%
duckdb / parquet / ns (1.103x ➖, 3↑ 4↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 2912570036 / 5253041788 / -44.6% 🟢 565605927 / 522439045 / +8.3% 5.15 / 10.05 / -48.8%
fineweb_q01/duckdb:parquet 5310655207 / 5310685518 / -0.0% 789735717 / 913170366 / -13.5% 6.72 / 5.82 / +15.6%
fineweb_q02/duckdb:parquet 5294014708 / 2997884607 / +76.6% 🔴 600734399 / 651242049 / -7.8% 8.81 / 4.60 / +91.4%
fineweb_q03/duckdb:parquet 3236200918 / 5319477790 / -39.2% 🟢 1247850990 / 1375255794 / -9.3% 2.59 / 3.87 / -33.0%
fineweb_q04/duckdb:parquet 5288679235 / 5298758590 / -0.2% 903493173 / 801678528 / +12.7% 5.85 / 6.61 / -11.4%
fineweb_q05/duckdb:parquet 5288451088 / 3150688998 / +67.9% 🔴 849621120 / 1044407671 / -18.7% 6.22 / 3.02 / +106.3%
fineweb_q06/duckdb:parquet 1356214864 / 3365967316 / -59.7% 🟢 1511748630 / 1412082784 / +7.1% 0.90 / 2.38 / -62.4%
fineweb_q07/duckdb:parquet 3124948998 / 951789892 / +228.3% 🔴 1102636338 / 1118306280 / -1.4% 2.83 / 0.85 / +233.0%
fineweb_q08/duckdb:parquet 5240299838 / 2867336480 / +82.8% 🔴 697753933 / 494033161 / +41.2% 🔴 7.51 / 5.80 / +29.4%

@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Statistical and Population Genetics 📖

Commits: PR ff9eddd4 vs base 68e2aee0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -4.2%
Engines: DuckDB No clear signal (-4.2%, low confidence)
Vortex (geomean): hot 0.946x ➖ · cold 0.980x ➖
Parquet (geomean): hot 0.987x ➖ · cold 0.982x ➖
Shifts: Parquet (control) -1.3% · Median polish -3.4%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (0.946x ➖, 3↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed 15250836 / 16323740 / -6.6% 26249162 / 29749881 / -11.8% 🟢 0.58 / 0.55 / +5.9%
statpopgen_q01/duckdb:vortex-file-compressed 13971445 / 14270145 / -2.1% 22473612 / 21687729 / +3.6% 0.62 / 0.66 / -5.5%
statpopgen_q02/duckdb:vortex-file-compressed 620407865 / 622676254 / -0.4% 648434831 / 720286054 / -10.0% 0.96 / 0.86 / +10.7%
statpopgen_q03/duckdb:vortex-file-compressed 1376411108 / 1637967368 / -16.0% 🟢 1963310894 / 1403123979 / +39.9% 🔴 0.70 / 1.17 / -39.9%
statpopgen_q04/duckdb:vortex-file-compressed 1320229640 / 1317810911 / +0.2% 1918993572 / 1851773208 / +3.6% 0.69 / 0.71 / -3.3%
statpopgen_q05/duckdb:vortex-file-compressed 623990177 / 665051680 / -6.2% 647997739 / 651829974 / -0.6% 0.96 / 1.02 / -5.6%
statpopgen_q06/duckdb:vortex-file-compressed 2144535472 / 1775913085 / +20.8% 🔴 1865039193 / 1802952002 / +3.4% 1.15 / 0.99 / +16.7%
statpopgen_q07/duckdb:vortex-file-compressed 246850456 / 315896918 / -21.9% 🟢 292165121 / 364932595 / -19.9% 🟢 0.84 / 0.87 / -2.4%
statpopgen_q08/duckdb:vortex-file-compressed 292822432 / 351893302 / -16.8% 🟢 385499197 / 457410254 / -15.7% 🟢 0.76 / 0.77 / -1.3%
statpopgen_q09/duckdb:vortex-file-compressed 1103318995 / 1067747574 / +3.3% 1064767747 / 1060673363 / +0.4% 1.04 / 1.01 / +2.9%
statpopgen_q10/duckdb:vortex-file-compressed 2934776728 / 3169552090 / -7.4% 3153932854 / 3279790450 / -3.8% 0.93 / 0.97 / -3.7%
duckdb / parquet / ns (0.987x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet 375753680 / 376727614 / -0.3% 376124485 / 378512175 / -0.6% 1.00 / 1.00 / +0.4%
statpopgen_q01/duckdb:parquet 466926764 / 463956368 / +0.6% 472625953 / 471276777 / +0.3% 0.99 / 0.98 / +0.4%
statpopgen_q02/duckdb:parquet 773065482 / 795238091 / -2.8% 806188948 / 831818238 / -3.1% 0.96 / 0.96 / +0.3%
statpopgen_q03/duckdb:parquet 1041963642 / 1064188382 / -2.1% 1086017796 / 1116279554 / -2.7% 0.96 / 0.95 / +0.6%
statpopgen_q04/duckdb:parquet 1049928540 / 1074572530 / -2.3% 1115443957 / 1113851143 / +0.1% 0.94 / 0.96 / -2.4%
statpopgen_q05/duckdb:parquet 770806063 / 775524609 / -0.6% 805765984 / 833554563 / -3.3% 0.96 / 0.93 / +2.8%
statpopgen_q06/duckdb:parquet 1031245274 / 1029738044 / +0.1% 1062917626 / 1062307389 / +0.1% 0.97 / 0.97 / +0.1%
statpopgen_q07/duckdb:parquet 954356524 / 951765009 / +0.3% 1148305709 / 1165702533 / -1.5% 0.83 / 0.82 / +1.8%
statpopgen_q08/duckdb:parquet 953833260 / 978737896 / -2.5% 1105587150 / 1156852256 / -4.4% 0.86 / 0.85 / +2.0%
statpopgen_q09/duckdb:parquet 988196562 / 1014221562 / -2.6% 1043436615 / 1073497880 / -2.8% 0.95 / 0.94 / +0.2%
statpopgen_q10/duckdb:parquet 1645179602 / 1673902526 / -1.7% 1680956605 / 1701851616 / -1.2% 0.98 / 0.98 / -0.5%

No file size changes detected.

@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR ff9eddd4 vs base 68e2aee0
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (-0.1%, low confidence) · DuckDB No clear signal (+0.6%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 0.987x ➖
Parquet (geomean): hot 1.002x ➖ · cold 1.002x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1888212 / 1890880 / -0.1% 42930294 / 41302569 / +3.9% 0.04 / 0.05 / -3.9%
clickbench_q01/datafusion:vortex-file-compressed 12163552 / 12450668 / -2.3% 63668747 / 63258714 / +0.6% 0.19 / 0.20 / -2.9%
clickbench_q02/datafusion:vortex-file-compressed 26102024 / 26843515 / -2.8% 75911532 / 75584240 / +0.4% 0.34 / 0.36 / -3.2%
clickbench_q03/datafusion:vortex-file-compressed 27297670 / 27652584 / -1.3% 98181097 / 99509641 / -1.3% 0.28 / 0.28 / +0.1%
clickbench_q04/datafusion:vortex-file-compressed 160679678 / 163346786 / -1.6% 233348508 / 238212631 / -2.0% 0.69 / 0.69 / +0.4%
clickbench_q05/datafusion:vortex-file-compressed 221628907 / 218319156 / +1.5% 302096731 / 294162726 / +2.7% 0.73 / 0.74 / -1.2%
clickbench_q06/datafusion:vortex-file-compressed 1900168 / 1903310 / -0.2% 39969560 / 40460067 / -1.2% 0.05 / 0.05 / +1.1%
clickbench_q07/datafusion:vortex-file-compressed 18927056 / 18827898 / +0.5% 68916532 / 68679167 / +0.3% 0.27 / 0.27 / +0.2%
clickbench_q08/datafusion:vortex-file-compressed 231609684 / 218069885 / +6.2% 308693287 / 308380103 / +0.1% 0.75 / 0.71 / +6.1%
clickbench_q09/datafusion:vortex-file-compressed 347367884 / 349588146 / -0.6% 426233283 / 414208278 / +2.9% 0.81 / 0.84 / -3.4%
clickbench_q10/datafusion:vortex-file-compressed 68828982 / 66239438 / +3.9% 133434876 / 130987326 / +1.9% 0.52 / 0.51 / +2.0%
clickbench_q11/datafusion:vortex-file-compressed 87890026 / 87014030 / +1.0% 150442386 / 149364292 / +0.7% 0.58 / 0.58 / +0.3%
clickbench_q12/datafusion:vortex-file-compressed 197123803 / 192874029 / +2.2% 284503584 / 277518625 / +2.5% 0.69 / 0.69 / -0.3%
clickbench_q13/datafusion:vortex-file-compressed 337763411 / 348362600 / -3.0% 466267684 / 444053789 / +5.0% 0.72 / 0.78 / -7.7%
clickbench_q14/datafusion:vortex-file-compressed 212099662 / 202961922 / +4.5% 292672909 / 283618938 / +3.2% 0.72 / 0.72 / +1.3%
clickbench_q15/datafusion:vortex-file-compressed 182501187 / 185015948 / -1.4% 271516090 / 259460430 / +4.6% 0.67 / 0.71 / -5.7%
clickbench_q16/datafusion:vortex-file-compressed 452532656 / 470400686 / -3.8% 564501890 / 571773249 / -1.3% 0.80 / 0.82 / -2.6%
clickbench_q17/datafusion:vortex-file-compressed 457470380 / 458566457 / -0.2% 559102777 / 562330497 / -0.6% 0.82 / 0.82 / +0.3%
clickbench_q18/datafusion:vortex-file-compressed 881418746 / 874545328 / +0.8% 988815402 / 988931543 / -0.0% 0.89 / 0.88 / +0.8%
clickbench_q19/datafusion:vortex-file-compressed 16903502 / 16817101 / +0.5% 90052957 / 87658601 / +2.7% 0.19 / 0.19 / -2.2%
clickbench_q20/datafusion:vortex-file-compressed 184229950 / 182092488 / +1.2% 395533711 / 380173288 / +4.0% 0.47 / 0.48 / -2.8%
clickbench_q21/datafusion:vortex-file-compressed 268597034 / 267253872 / +0.5% 468134884 / 476228711 / -1.7% 0.57 / 0.56 / +2.2%
clickbench_q22/datafusion:vortex-file-compressed 325844992 / 327907669 / -0.6% 614635752 / 589035293 / +4.3% 0.53 / 0.56 / -4.8%
clickbench_q23/datafusion:vortex-file-compressed 617862448 / 587533489 / +5.2% 882341497 / 884193066 / -0.2% 0.70 / 0.66 / +5.4%
clickbench_q24/datafusion:vortex-file-compressed 42121610 / 41337764 / +1.9% 118409952 / 116904687 / +1.3% 0.36 / 0.35 / +0.6%
clickbench_q25/datafusion:vortex-file-compressed 55090496 / 54350322 / +1.4% 121158074 / 124946048 / -3.0% 0.45 / 0.43 / +4.5%
clickbench_q26/datafusion:vortex-file-compressed 41984958 / 43871418 / -4.3% 119412067 / 115731658 / +3.2% 0.35 / 0.38 / -7.2%
clickbench_q27/datafusion:vortex-file-compressed 267527046 / 275531112 / -2.9% 456561627 / 448056512 / +1.9% 0.59 / 0.61 / -4.7%
clickbench_q28/datafusion:vortex-file-compressed 1461533090 / 1439481564 / +1.5% 1519969136 / 1536834794 / -1.1% 0.96 / 0.94 / +2.7%
clickbench_q29/datafusion:vortex-file-compressed 38480152 / 38911724 / -1.1% 90194635 / 91482624 / -1.4% 0.43 / 0.43 / +0.3%
clickbench_q30/datafusion:vortex-file-compressed 176748010 / 172283358 / +2.6% 257881379 / 260355101 / -1.0% 0.69 / 0.66 / +3.6%
clickbench_q31/datafusion:vortex-file-compressed 194499956 / 197082484 / -1.3% 319245127 / 326887348 / -2.3% 0.61 / 0.60 / +1.1%
clickbench_q32/datafusion:vortex-file-compressed 826654891 / 827511578 / -0.1% 940435157 / 950039812 / -1.0% 0.88 / 0.87 / +0.9%
clickbench_q33/datafusion:vortex-file-compressed 1009792866 / 1021855940 / -1.2% 1180599950 / 1186573596 / -0.5% 0.86 / 0.86 / -0.7%
clickbench_q34/datafusion:vortex-file-compressed 1017397494 / 997694779 / +2.0% 1184728301 / 1214915857 / -2.5% 0.86 / 0.82 / +4.6%
clickbench_q35/datafusion:vortex-file-compressed 153609830 / 147530098 / +4.1% 215086170 / 222654728 / -3.4% 0.71 / 0.66 / +7.8%
clickbench_q36/datafusion:vortex-file-compressed 56879874 / 55979010 / +1.6% 119636269 / 125196809 / -4.4% 0.48 / 0.45 / +6.3%
clickbench_q37/datafusion:vortex-file-compressed 28764576 / 28173102 / +2.1% 83261469 / 87078426 / -4.4% 0.35 / 0.32 / +6.8%
clickbench_q38/datafusion:vortex-file-compressed 15934876 / 15331602 / +3.9% 69379188 / 72472555 / -4.3% 0.23 / 0.21 / +8.6%
clickbench_q39/datafusion:vortex-file-compressed 109647640 / 111063552 / -1.3% 183972653 / 184392066 / -0.2% 0.60 / 0.60 / -1.0%
clickbench_q40/datafusion:vortex-file-compressed 13444094 / 13435826 / +0.1% 63235896 / 69070892 / -8.4% 0.21 / 0.19 / +9.3%
clickbench_q41/datafusion:vortex-file-compressed 13182968 / 12529152 / +5.2% 64487701 / 61128630 / +5.5% 0.20 / 0.20 / -0.3%
clickbench_q42/datafusion:vortex-file-compressed 13884155 / 13698448 / +1.4% 61134881 / 63653646 / -4.0% 0.23 / 0.22 / +5.5%
datafusion / parquet / ns (1.007x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1858798 / 1874536 / -0.8% 79580924 / 76872914 / +3.5% 0.02 / 0.02 / -4.2%
clickbench_q01/datafusion:parquet 16529078 / 16556410 / -0.2% 112649436 / 110817989 / +1.7% 0.15 / 0.15 / -1.8%
clickbench_q02/datafusion:parquet 35743830 / 32852025 / +8.8% 135712459 / 137120291 / -1.0% 0.26 / 0.24 / +9.9%
clickbench_q03/datafusion:parquet 28752620 / 26892712 / +6.9% 136318870 / 134945023 / +1.0% 0.21 / 0.20 / +5.8%
clickbench_q04/datafusion:parquet 173731040 / 172210149 / +0.9% 295298498 / 304630381 / -3.1% 0.59 / 0.57 / +4.1%
clickbench_q05/datafusion:parquet 241351929 / 237954857 / +1.4% 365549374 / 371035926 / -1.5% 0.66 / 0.64 / +2.9%
clickbench_q06/datafusion:parquet 1897865 / 1954147 / -2.9% 77393206 / 76229350 / +1.5% 0.02 / 0.03 / -4.3%
clickbench_q07/datafusion:parquet 18824330 / 19925329 / -5.5% 120110676 / 115429797 / +4.1% 0.16 / 0.17 / -9.2%
clickbench_q08/datafusion:parquet 227583612 / 228031282 / -0.2% 380031262 / 374659705 / +1.4% 0.60 / 0.61 / -1.6%
clickbench_q09/datafusion:parquet 371753559 / 354851564 / +4.8% 503304943 / 508263399 / -1.0% 0.74 / 0.70 / +5.8%
clickbench_q10/datafusion:parquet 72691088 / 72416684 / +0.4% 198478978 / 201799249 / -1.6% 0.37 / 0.36 / +2.1%
clickbench_q11/datafusion:parquet 88662028 / 89214875 / -0.6% 209720527 / 214273559 / -2.1% 0.42 / 0.42 / +1.5%
clickbench_q12/datafusion:parquet 239054604 / 238983674 / +0.0% 369142426 / 366413572 / +0.7% 0.65 / 0.65 / -0.7%
clickbench_q13/datafusion:parquet 383626787 / 392685378 / -2.3% 533656570 / 538053020 / -0.8% 0.72 / 0.73 / -1.5%
clickbench_q14/datafusion:parquet 248532799 / 251621070 / -1.2% 384699490 / 393019445 / -2.1% 0.65 / 0.64 / +0.9%
clickbench_q15/datafusion:parquet 195909070 / 196978404 / -0.5% 328220501 / 326777442 / +0.4% 0.60 / 0.60 / -1.0%
clickbench_q16/datafusion:parquet 469305972 / 484251277 / -3.1% 622465536 / 630514559 / -1.3% 0.75 / 0.77 / -1.8%
clickbench_q17/datafusion:parquet 474043218 / 473268760 / +0.2% 637781469 / 624555112 / +2.1% 0.74 / 0.76 / -1.9%
clickbench_q18/datafusion:parquet 899164271 / 891961520 / +0.8% 1098101937 / 1064494426 / +3.2% 0.82 / 0.84 / -2.3%
clickbench_q19/datafusion:parquet 23378956 / 22044600 / +6.1% 128486290 / 122692943 / +4.7% 0.18 / 0.18 / +1.3%
clickbench_q20/datafusion:parquet 452288728 / 456793012 / -1.0% 605576579 / 611525838 / -1.0% 0.75 / 0.75 / -0.0%
clickbench_q21/datafusion:parquet 432614038 / 444894109 / -2.8% 607574890 / 606776722 / +0.1% 0.71 / 0.73 / -2.9%
clickbench_q22/datafusion:parquet 608972282 / 610379046 / -0.2% 843737270 / 833062975 / +1.3% 0.72 / 0.73 / -1.5%
clickbench_q23/datafusion:parquet 2390466203 / 2430100364 / -1.6% 2947500735 / 2766738603 / +6.5% 0.81 / 0.88 / -7.7%
clickbench_q24/datafusion:parquet 43031771 / 42135401 / +2.1% 137736476 / 138966749 / -0.9% 0.31 / 0.30 / +3.0%
clickbench_q25/datafusion:parquet 90231478 / 89249456 / +1.1% 203705491 / 199066447 / +2.3% 0.44 / 0.45 / -1.2%
clickbench_q26/datafusion:parquet 45410504 / 43463634 / +4.5% 140089970 / 139801520 / +0.2% 0.32 / 0.31 / +4.3%
clickbench_q27/datafusion:parquet 517897340 / 526928530 / -1.7% 693803634 / 697807962 / -0.6% 0.75 / 0.76 / -1.1%
clickbench_q28/datafusion:parquet 1544251655 / 1514452238 / +2.0% 1653544326 / 1626290892 / +1.7% 0.93 / 0.93 / +0.3%
clickbench_q29/datafusion:parquet 39641876 / 38022678 / +4.3% 149735712 / 142489452 / +5.1% 0.26 / 0.27 / -0.8%
clickbench_q30/datafusion:parquet 230462960 / 234536487 / -1.7% 390925188 / 385549554 / +1.4% 0.59 / 0.61 / -3.1%
clickbench_q31/datafusion:parquet 269844040 / 272224790 / -0.9% 450904865 / 434990032 / +3.7% 0.60 / 0.63 / -4.4%
clickbench_q32/datafusion:parquet 846549936 / 842224345 / +0.5% 1016331905 / 1014069577 / +0.2% 0.83 / 0.83 / +0.3%
clickbench_q33/datafusion:parquet 1096777486 / 1082769461 / +1.3% 1301964465 / 1285796902 / +1.3% 0.84 / 0.84 / +0.0%
clickbench_q34/datafusion:parquet 1080694902 / 1086460580 / -0.5% 1283080877 / 1318340388 / -2.7% 0.84 / 0.82 / +2.2%
clickbench_q35/datafusion:parquet 160975568 / 163031332 / -1.3% 291071362 / 288231384 / +1.0% 0.55 / 0.57 / -2.2%
clickbench_q36/datafusion:parquet 107654692 / 106591720 / +1.0% 224111890 / 221014726 / +1.4% 0.48 / 0.48 / -0.4%
clickbench_q37/datafusion:parquet 48100130 / 48615339 / -1.1% 149701606 / 144594879 / +3.5% 0.32 / 0.34 / -4.4%
clickbench_q38/datafusion:parquet 66016738 / 65730877 / +0.4% 169874159 / 169270480 / +0.4% 0.39 / 0.39 / +0.1%
clickbench_q39/datafusion:parquet 203378910 / 205676670 / -1.1% 324996100 / 323890895 / +0.3% 0.63 / 0.64 / -1.5%
clickbench_q40/datafusion:parquet 26300670 / 25999274 / +1.2% 128980141 / 127783628 / +0.9% 0.20 / 0.20 / +0.2%
clickbench_q41/datafusion:parquet 26590691 / 25005636 / +6.3% 118927566 / 122213645 / -2.7% 0.22 / 0.20 / +9.3%
clickbench_q42/datafusion:parquet 26615318 / 24943142 / +6.7% 117240318 / 118678405 / -1.2% 0.23 / 0.21 / +8.0%
duckdb / vortex-file-compressed / ns (1.003x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 14773428 / 14661813 / +0.8% 69208912 / 77873691 / -11.1% 🟢 0.21 / 0.19 / +13.4%
clickbench_q01/duckdb:vortex-file-compressed 19749246 / 18765855 / +5.2% 105481511 / 89168045 / +18.3% 🔴 0.19 / 0.21 / -11.0%
clickbench_q02/duckdb:vortex-file-compressed 22821574 / 22220985 / +2.7% 107606335 / 118028324 / -8.8% 0.21 / 0.19 / +12.6%
clickbench_q03/duckdb:vortex-file-compressed 32634884 / 34811074 / -6.3% 105945192 / 113594967 / -6.7% 0.31 / 0.31 / +0.5%
clickbench_q04/duckdb:vortex-file-compressed 133525773 / 134045862 / -0.4% 215356379 / 202089823 / +6.6% 0.62 / 0.66 / -6.5%
clickbench_q05/duckdb:vortex-file-compressed 155312182 / 158164897 / -1.8% 237645018 / 243531341 / -2.4% 0.65 / 0.65 / +0.6%
clickbench_q06/duckdb:vortex-file-compressed 20612408 / 22212574 / -7.2% 99361898 / 95665745 / +3.9% 0.21 / 0.23 / -10.7%
clickbench_q07/duckdb:vortex-file-compressed 22706719 / 21631638 / +5.0% 101428494 / 99885761 / +1.5% 0.22 / 0.22 / +3.4%
clickbench_q08/duckdb:vortex-file-compressed 173371287 / 173657990 / -0.2% 286668457 / 298972647 / -4.1% 0.60 / 0.58 / +4.1%
clickbench_q09/duckdb:vortex-file-compressed 215078700 / 212976858 / +1.0% 343266481 / 344682319 / -0.4% 0.63 / 0.62 / +1.4%
clickbench_q10/duckdb:vortex-file-compressed 73237012 / 75840046 / -3.4% 178805433 / 184992498 / -3.3% 0.41 / 0.41 / -0.1%
clickbench_q11/duckdb:vortex-file-compressed 91600874 / 96909371 / -5.5% 195409243 / 194378366 / +0.5% 0.47 / 0.50 / -6.0%
clickbench_q12/duckdb:vortex-file-compressed 178554920 / 176859996 / +1.0% 284405471 / 287254439 / -1.0% 0.63 / 0.62 / +2.0%
clickbench_q13/duckdb:vortex-file-compressed 316764467 / 324439195 / -2.4% 446015741 / 455265019 / -2.0% 0.71 / 0.71 / -0.3%
clickbench_q14/duckdb:vortex-file-compressed 192832392 / 193970731 / -0.6% 303375763 / 303120501 / +0.1% 0.64 / 0.64 / -0.7%
clickbench_q15/duckdb:vortex-file-compressed 185570834 / 185213450 / +0.2% 301976097 / 287245263 / +5.1% 0.61 / 0.64 / -4.7%
clickbench_q16/duckdb:vortex-file-compressed 378197039 / 374451968 / +1.0% 491328401 / 503313554 / -2.4% 0.77 / 0.74 / +3.5%
clickbench_q17/duckdb:vortex-file-compressed 377429616 / 374930534 / +0.7% 482708141 / 489272859 / -1.3% 0.78 / 0.77 / +2.0%
clickbench_q18/duckdb:vortex-file-compressed 742571321 / 725598138 / +2.3% 856991621 / 893904963 / -4.1% 0.87 / 0.81 / +6.7%
clickbench_q19/duckdb:vortex-file-compressed 27526776 / 26964996 / +2.1% 114344683 / 119354770 / -4.2% 0.24 / 0.23 / +6.6%
clickbench_q20/duckdb:vortex-file-compressed 243447758 / 243282502 / +0.1% 438338607 / 443694421 / -1.2% 0.56 / 0.55 / +1.3%
clickbench_q21/duckdb:vortex-file-compressed 373758682 / 376903068 / -0.8% 669896426 / 658964954 / +1.7% 0.56 / 0.57 / -2.5%
clickbench_q22/duckdb:vortex-file-compressed 575856856 / 560267532 / +2.8% 961761895 / 962996123 / -0.1% 0.60 / 0.58 / +2.9%
clickbench_q23/duckdb:vortex-file-compressed 127366324 / 121737276 / +4.6% 226891148 / 241270713 / -6.0% 0.56 / 0.50 / +11.3%
clickbench_q24/duckdb:vortex-file-compressed 39756984 / 40164094 / -1.0% 93362987 / 97601829 / -4.3% 0.43 / 0.41 / +3.5%
clickbench_q25/duckdb:vortex-file-compressed 62710008 / 60514628 / +3.6% 141219472 / 141820082 / -0.4% 0.44 / 0.43 / +4.1%
clickbench_q26/duckdb:vortex-file-compressed 35353114 / 32383049 / +9.2% 92481071 / 97175858 / -4.8% 0.38 / 0.33 / +14.7%
clickbench_q27/duckdb:vortex-file-compressed 242395036 / 256993896 / -5.7% 520654631 / 510898760 / +1.9% 0.47 / 0.50 / -7.4%
clickbench_q28/duckdb:vortex-file-compressed 1372826618 / 1312171982 / +4.6% 1465579152 / 1394696240 / +5.1% 0.94 / 0.94 / -0.4%
clickbench_q29/duckdb:vortex-file-compressed 30100784 / 31353157 / -4.0% 113454127 / 112837648 / +0.5% 0.27 / 0.28 / -4.5%
clickbench_q30/duckdb:vortex-file-compressed 172754118 / 173588846 / -0.5% 292868991 / 294274802 / -0.5% 0.59 / 0.59 / -0.0%
clickbench_q31/duckdb:vortex-file-compressed 302495102 / 301426662 / +0.4% 474946883 / 466277881 / +1.9% 0.64 / 0.65 / -1.5%
clickbench_q32/duckdb:vortex-file-compressed 922658934 / 919577680 / +0.3% 1075082587 / 1079335130 / -0.4% 0.86 / 0.85 / +0.7%
clickbench_q33/duckdb:vortex-file-compressed 1041965558 / 1061942144 / -1.9% 1294459641 / 1283675650 / +0.8% 0.80 / 0.83 / -2.7%
clickbench_q34/duckdb:vortex-file-compressed 1072698718 / 1086670044 / -1.3% 1369982871 / 1344407192 / +1.9% 0.78 / 0.81 / -3.1%
clickbench_q35/duckdb:vortex-file-compressed 210910790 / 208577397 / +1.1% 285038289 / 304028372 / -6.2% 0.74 / 0.69 / +7.9%
clickbench_q36/duckdb:vortex-file-compressed 29990698 / 29028280 / +3.3% 111620777 / 124495435 / -10.3% 🟢 0.27 / 0.23 / +15.2%
clickbench_q37/duckdb:vortex-file-compressed 19546186 / 19340104 / +1.1% 90319989 / 95883106 / -5.8% 0.22 / 0.20 / +7.3%
clickbench_q38/duckdb:vortex-file-compressed 22988082 / 22883719 / +0.5% 109963275 / 117112599 / -6.1% 0.21 / 0.20 / +7.0%
clickbench_q39/duckdb:vortex-file-compressed 48535536 / 46848798 / +3.6% 135383574 / 151574075 / -10.7% 🟢 0.36 / 0.31 / +16.0%
clickbench_q40/duckdb:vortex-file-compressed 17146090 / 16798546 / +2.1% 79415363 / 90578945 / -12.3% 🟢 0.22 / 0.19 / +16.4%
clickbench_q41/duckdb:vortex-file-compressed 18705234 / 18879972 / -0.9% 87538986 / 97231893 / -10.0% 0.21 / 0.19 / +10.0%
clickbench_q42/duckdb:vortex-file-compressed 19025494 / 19012525 / +0.1% 75096890 / 91055747 / -17.5% 🟢 0.25 / 0.21 / +21.3%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 16724092 / 16571886 / +0.9% 40175398 / 44125879 / -9.0% 0.42 / 0.38 / +10.8%
clickbench_q01/duckdb:parquet 16025852 / 17589878 / -8.9% 36251529 / 39752234 / -8.8% 0.44 / 0.44 / -0.1%
clickbench_q02/duckdb:parquet 25881572 / 26482712 / -2.3% 56144544 / 60618321 / -7.4% 0.46 / 0.44 / +5.5%
clickbench_q03/duckdb:parquet 29915020 / 28526048 / +4.9% 86347979 / 90266392 / -4.3% 0.35 / 0.32 / +9.6%
clickbench_q04/duckdb:parquet 136112887 / 133105014 / +2.3% 191808722 / 185364236 / +3.5% 0.71 / 0.72 / -1.2%
clickbench_q05/duckdb:parquet 182332786 / 197019720 / -7.5% 263234911 / 258563451 / +1.8% 0.69 / 0.76 / -9.1%
clickbench_q06/duckdb:parquet 25792696 / 26474712 / -2.6% 45885731 / 44532072 / +3.0% 0.56 / 0.59 / -5.5%
clickbench_q07/duckdb:parquet 20546479 / 18822996 / +9.2% 41061667 / 41336501 / -0.7% 0.50 / 0.46 / +9.9%
clickbench_q08/duckdb:parquet 163969182 / 168460452 / -2.7% 251068434 / 257690803 / -2.6% 0.65 / 0.65 / -0.1%
clickbench_q09/duckdb:parquet 228392201 / 231640070 / -1.4% 310862098 / 307534705 / +1.1% 0.73 / 0.75 / -2.5%
clickbench_q10/duckdb:parquet 62619914 / 61505002 / +1.8% 120051003 / 118712608 / +1.1% 0.52 / 0.52 / +0.7%
clickbench_q11/duckdb:parquet 72554553 / 69727960 / +4.1% 135892814 / 131071679 / +3.7% 0.53 / 0.53 / +0.4%
clickbench_q12/duckdb:parquet 175235524 / 175496826 / -0.1% 283713813 / 275479488 / +3.0% 0.62 / 0.64 / -3.0%
clickbench_q13/duckdb:parquet 309649652 / 316097624 / -2.0% 429319505 / 429198214 / +0.0% 0.72 / 0.74 / -2.1%
clickbench_q14/duckdb:parquet 190350982 / 192838982 / -1.3% 306347132 / 276795543 / +10.7% 🔴 0.62 / 0.70 / -10.8%
clickbench_q15/duckdb:parquet 179078294 / 188870742 / -5.2% 232372670 / 240499108 / -3.4% 0.77 / 0.79 / -1.9%
clickbench_q16/duckdb:parquet 353037522 / 361345798 / -2.3% 468035267 / 475264215 / -1.5% 0.75 / 0.76 / -0.8%
clickbench_q17/duckdb:parquet 350463335 / 362582264 / -3.3% 474198188 / 463962985 / +2.2% 0.74 / 0.78 / -5.4%
clickbench_q18/duckdb:parquet 692189074 / 680590324 / +1.7% 855159422 / 881184903 / -3.0% 0.81 / 0.77 / +4.8%
clickbench_q19/duckdb:parquet 24375035 / 25194052 / -3.3% 67347354 / 67335393 / +0.0% 0.36 / 0.37 / -3.3%
clickbench_q20/duckdb:parquet 274526000 / 268697068 / +2.2% 457479519 / 452202063 / +1.2% 0.60 / 0.59 / +1.0%
clickbench_q21/duckdb:parquet 328466500 / 320520004 / +2.5% 618238157 / 609636992 / +1.4% 0.53 / 0.53 / +1.1%
clickbench_q22/duckdb:parquet 476951957 / 474026948 / +0.6% 786762951 / 779306176 / +1.0% 0.61 / 0.61 / -0.3%
clickbench_q23/duckdb:parquet 256928618 / 247968431 / +3.6% 296075185 / 301901148 / -1.9% 0.87 / 0.82 / +5.7%
clickbench_q24/duckdb:parquet 74280377 / 76289506 / -2.6% 115610588 / 122345047 / -5.5% 0.64 / 0.62 / +3.0%
clickbench_q25/duckdb:parquet 74900082 / 73738790 / +1.6% 190977282 / 180898060 / +5.6% 0.39 / 0.41 / -3.8%
clickbench_q26/duckdb:parquet 52644262 / 55374838 / -4.9% 91492753 / 103928033 / -12.0% 🟢 0.58 / 0.53 / +8.0%
clickbench_q27/duckdb:parquet 286167732 / 273865734 / +4.5% 510741238 / 506603805 / +0.8% 0.56 / 0.54 / +3.6%
clickbench_q28/duckdb:parquet 1697948604 / 1709305608 / -0.7% 2157356993 / 2171797191 / -0.7% 0.79 / 0.79 / +0.0%
clickbench_q29/duckdb:parquet 28183547 / 28488391 / -1.1% 60782793 / 57338831 / +6.0% 0.46 / 0.50 / -6.7%
clickbench_q30/duckdb:parquet 179961346 / 178301456 / +0.9% 336694549 / 337108883 / -0.1% 0.53 / 0.53 / +1.1%
clickbench_q31/duckdb:parquet 317877876 / 310893033 / +2.2% 600791947 / 594845284 / +1.0% 0.53 / 0.52 / +1.2%
clickbench_q32/duckdb:parquet 913391894 / 914980178 / -0.2% 994336581 / 1098019001 / -9.4% 0.92 / 0.83 / +10.2%
clickbench_q33/duckdb:parquet 773876204 / 787776597 / -1.8% 978763648 / 997543937 / -1.9% 0.79 / 0.79 / +0.1%
clickbench_q34/duckdb:parquet 795439146 / 798812142 / -0.4% 969889090 / 971112163 / -0.1% 0.82 / 0.82 / -0.3%
clickbench_q35/duckdb:parquet 208154403 / 206644759 / +0.7% 239836308 / 237036907 / +1.2% 0.87 / 0.87 / -0.4%
clickbench_q36/duckdb:parquet 50320860 / 51268154 / -1.8% 72663839 / 72118021 / +0.8% 0.69 / 0.71 / -2.6%
clickbench_q37/duckdb:parquet 37227694 / 38025062 / -2.1% 55568234 / 56928408 / -2.4% 0.67 / 0.67 / +0.3%
clickbench_q38/duckdb:parquet 38430118 / 38341854 / +0.2% 58928528 / 59227356 / -0.5% 0.65 / 0.65 / +0.7%
clickbench_q39/duckdb:parquet 94375762 / 90935003 / +3.8% 128512333 / 113521177 / +13.2% 🔴 0.73 / 0.80 / -8.3%
clickbench_q40/duckdb:parquet 20183276 / 21165898 / -4.6% 41980029 / 42310791 / -0.8% 0.48 / 0.50 / -3.9%
clickbench_q41/duckdb:parquet 20781702 / 21021462 / -1.1% 43182524 / 41482911 / +4.1% 0.48 / 0.51 / -5.0%
clickbench_q42/duckdb:parquet 24548102 / 22913562 / +7.1% 44525089 / 44605327 / -0.2% 0.55 / 0.51 / +7.3%

No file size changes detected.

@github-actions

github-actions Bot commented Aug 27, 2026

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR ff9eddd4 vs base 68e2aee0
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +1.1%
Engines: DataFusion No clear signal (+3.5%, environment too noisy confidence) · DuckDB No clear signal (-1.2%, low confidence)
Vortex (geomean): hot 0.992x ➖ · cold 0.962x ➖
Parquet (geomean): hot 0.982x ➖ · cold 0.913x ➖
Shifts: Parquet (control) -1.8% · Median polish -1.0%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.988x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 236337320 / 231856055 / +1.9% 674512961 / 664332216 / +1.5% 0.35 / 0.35 / +0.4%
tpch_q02/datafusion:vortex-file-compressed 323286537 / 302239781 / +7.0% 622370716 / 624474483 / -0.3% 0.52 / 0.48 / +7.3%
tpch_q03/datafusion:vortex-file-compressed 399997958 / 324081519 / +23.4% 982554094 / 1153509123 / -14.8% 0.41 / 0.28 / +44.9%
tpch_q04/datafusion:vortex-file-compressed 186047703 / 157188213 / +18.4% 420835622 / 430264165 / -2.2% 0.44 / 0.37 / +21.0%
tpch_q05/datafusion:vortex-file-compressed 327865356 / 341093983 / -3.9% 577825564 / 584822499 / -1.2% 0.57 / 0.58 / -2.7%
tpch_q06/datafusion:vortex-file-compressed 243751863 / 268053272 / -9.1% 421610637 / 392164526 / +7.5% 0.58 / 0.68 / -15.4%
tpch_q07/datafusion:vortex-file-compressed 380338013 / 361220001 / +5.3% 601951070 / 547066288 / +10.0% 0.63 / 0.66 / -4.3%
tpch_q08/datafusion:vortex-file-compressed 377616573 / 424840872 / -11.1% 581344386 / 597332431 / -2.7% 0.65 / 0.71 / -8.7%
tpch_q09/datafusion:vortex-file-compressed 277010418 / 278792005 / -0.6% 629150273 / 493702505 / +27.4% 0.44 / 0.56 / -22.0%
tpch_q10/datafusion:vortex-file-compressed 354011305 / 598628831 / -40.9% 🟢 531537141 / 503538310 / +5.6% 0.67 / 1.19 / -44.0%
tpch_q11/datafusion:vortex-file-compressed 257922395 / 320619298 / -19.6% 435290788 / 479850056 / -9.3% 0.59 / 0.67 / -11.3%
tpch_q12/datafusion:vortex-file-compressed 284602731 / 329858398 / -13.7% 660673704 / 606439075 / +8.9% 0.43 / 0.54 / -20.8%
tpch_q13/datafusion:vortex-file-compressed 112469888 / 137110919 / -18.0% 365903025 / 507511536 / -27.9% 0.31 / 0.27 / +13.8%
tpch_q14/datafusion:vortex-file-compressed 175305029 / 194634341 / -9.9% 336530976 / 387398690 / -13.1% 0.52 / 0.50 / +3.7%
tpch_q15/datafusion:vortex-file-compressed 292244745 / 300574908 / -2.8% 504533029 / 560504753 / -10.0% 0.58 / 0.54 / +8.0%
tpch_q16/datafusion:vortex-file-compressed 161804301 / 160180968 / +1.0% 386215524 / 373909021 / +3.3% 0.42 / 0.43 / -2.2%
tpch_q17/datafusion:vortex-file-compressed 278403187 / 308281360 / -9.7% 512175599 / 464875418 / +10.2% 0.54 / 0.66 / -18.0%
tpch_q18/datafusion:vortex-file-compressed 247560528 / 218576292 / +13.3% 440140892 / 412389614 / +6.7% 0.56 / 0.53 / +6.1%
tpch_q19/datafusion:vortex-file-compressed 411052599 / 346680402 / +18.6% 529520144 / 522269995 / +1.4% 0.78 / 0.66 / +16.9%
tpch_q20/datafusion:vortex-file-compressed 288161417 / 288181019 / -0.0% 493085380 / 460787131 / +7.0% 0.58 / 0.63 / -6.6%
tpch_q21/datafusion:vortex-file-compressed 651859193 / 403708212 / +61.5% 🔴 641263443 / 621749704 / +3.1% 1.02 / 0.65 / +56.6%
tpch_q22/datafusion:vortex-file-compressed 180948481 / 179428617 / +0.8% 352858690 / 634662869 / -44.4% 🟢 0.51 / 0.28 / +81.4%
datafusion / parquet / ns (0.955x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 213049829 / 468043327 / -54.5% 🟢 516493827 / 859247026 / -39.9% 🟢 0.41 / 0.54 / -24.3%
tpch_q02/datafusion:parquet 266953255 / 329931196 / -19.1% 512056955 / 597708649 / -14.3% 0.52 / 0.55 / -5.6%
tpch_q03/datafusion:parquet 289811247 / 307671723 / -5.8% 660390577 / 807967643 / -18.3% 0.44 / 0.38 / +15.2%
tpch_q04/datafusion:parquet 169413576 / 204810556 / -17.3% 420731278 / 591293640 / -28.8% 0.40 / 0.35 / +16.3%
tpch_q05/datafusion:parquet 393065000 / 374619762 / +4.9% 475885790 / 545959338 / -12.8% 0.83 / 0.69 / +20.4%
tpch_q06/datafusion:parquet 156431209 / 156725755 / -0.2% 289639714 / 292749936 / -1.1% 0.54 / 0.54 / +0.9%
tpch_q07/datafusion:parquet 389604270 / 388360244 / +0.3% 734033421 / 506130480 / +45.0% 🔴 0.53 / 0.77 / -30.8%
tpch_q08/datafusion:parquet 413449750 / 438978227 / -5.8% 547362501 / 608419846 / -10.0% 0.76 / 0.72 / +4.7%
tpch_q09/datafusion:parquet 439989433 / 493522543 / -10.8% 636785202 / 664938906 / -4.2% 0.69 / 0.74 / -6.9%
tpch_q10/datafusion:parquet 407080168 / 435345374 / -6.5% 574568807 / 634776380 / -9.5% 0.71 / 0.69 / +3.3%
tpch_q11/datafusion:parquet 277451161 / 271749815 / +2.1% 424447321 / 502219221 / -15.5% 0.65 / 0.54 / +20.8%
tpch_q12/datafusion:parquet 224122684 / 199620592 / +12.3% 386570969 / 477701519 / -19.1% 0.58 / 0.42 / +38.7%
tpch_q13/datafusion:parquet 440720619 / 458788311 / -3.9% 572917052 / 751500829 / -23.8% 0.77 / 0.61 / +26.0%
tpch_q14/datafusion:parquet 167801775 / 175613459 / -4.4% 338031767 / 377970049 / -10.6% 0.50 / 0.46 / +6.8%
tpch_q15/datafusion:parquet 301523886 / 276936654 / +8.9% 521462801 / 444350989 / +17.4% 0.58 / 0.62 / -7.2%
tpch_q16/datafusion:parquet 129431922 / 123170327 / +5.1% 271817515 / 358193947 / -24.1% 0.48 / 0.34 / +38.5%
tpch_q17/datafusion:parquet 295798467 / 300800609 / -1.7% 440021167 / 671535896 / -34.5% 🟢 0.67 / 0.45 / +50.1%
tpch_q18/datafusion:parquet 455307661 / 416717746 / +9.3% 583687099 / 560432917 / +4.1% 0.78 / 0.74 / +4.9%
tpch_q19/datafusion:parquet 194808129 / 179659167 / +8.4% 343142205 / 335783407 / +2.2% 0.57 / 0.54 / +6.1%
tpch_q20/datafusion:parquet 286102151 / 253528158 / +12.8% 448605904 / 486604835 / -7.8% 0.64 / 0.52 / +22.4%
tpch_q21/datafusion:parquet 377606438 / 318889353 / +18.4% 471941873 / 517647010 / -8.8% 0.80 / 0.62 / +29.9%
tpch_q22/datafusion:parquet 172519353 / 212078972 / -18.7% 343509259 / 390975789 / -12.1% 0.50 / 0.54 / -7.4%
duckdb / vortex-file-compressed / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 202740655 / 211615655 / -4.2% 260310964 / 319079109 / -18.4% 0.78 / 0.66 / +17.4%
tpch_q02/duckdb:vortex-file-compressed 376268963 / 391554867 / -3.9% 394225932 / 439341074 / -10.3% 0.95 / 0.89 / +7.1%
tpch_q03/duckdb:vortex-file-compressed 412899923 / 431418021 / -4.3% 529038545 / 534330337 / -1.0% 0.78 / 0.81 / -3.3%
tpch_q04/duckdb:vortex-file-compressed 230475315 / 262653717 / -12.3% 317308542 / 425970741 / -25.5% 0.73 / 0.62 / +17.8%
tpch_q05/duckdb:vortex-file-compressed 441546923 / 450598388 / -2.0% 440484872 / 453988717 / -3.0% 1.00 / 0.99 / +1.0%
tpch_q06/duckdb:vortex-file-compressed 252917596 / 272178361 / -7.1% 440153708 / 291130462 / +51.2% 🔴 0.57 / 0.93 / -38.5%
tpch_q07/duckdb:vortex-file-compressed 426112782 / 434959978 / -2.0% 510633954 / 475263519 / +7.4% 0.83 / 0.92 / -8.8%
tpch_q08/duckdb:vortex-file-compressed 523049551 / 529291407 / -1.2% 589094393 / 584795804 / +0.7% 0.89 / 0.91 / -1.9%
tpch_q09/duckdb:vortex-file-compressed 521326062 / 461013058 / +13.1% 579526616 / 729559977 / -20.6% 0.90 / 0.63 / +42.4%
tpch_q10/duckdb:vortex-file-compressed 429675740 / 436971801 / -1.7% 470956831 / 501747415 / -6.1% 0.91 / 0.87 / +4.8%
tpch_q11/duckdb:vortex-file-compressed 139381662 / 137937830 / +1.0% 170466891 / 185950754 / -8.3% 0.82 / 0.74 / +10.2%
tpch_q12/duckdb:vortex-file-compressed 505068203 / 432679813 / +16.7% 612868947 / 852364675 / -28.1% 0.82 / 0.51 / +62.3%
tpch_q13/duckdb:vortex-file-compressed 312916146 / 289528041 / +8.1% 319640502 / 389271529 / -17.9% 0.98 / 0.74 / +31.6%
tpch_q14/duckdb:vortex-file-compressed 224539452 / 231935170 / -3.2% 332449678 / 281108132 / +18.3% 0.68 / 0.83 / -18.1%
tpch_q15/duckdb:vortex-file-compressed 174841617 / 150104922 / +16.5% 254306596 / 226888996 / +12.1% 0.69 / 0.66 / +3.9%
tpch_q16/duckdb:vortex-file-compressed 182376377 / 200853373 / -9.2% 188998326 / 219732528 / -14.0% 0.96 / 0.91 / +5.6%
tpch_q17/duckdb:vortex-file-compressed 380859169 / 369328726 / +3.1% 426904225 / 408531657 / +4.5% 0.89 / 0.90 / -1.3%
tpch_q18/duckdb:vortex-file-compressed 325130149 / 308225837 / +5.5% 390589732 / 442272991 / -11.7% 0.83 / 0.70 / +19.4%
tpch_q19/duckdb:vortex-file-compressed 338120774 / 334814078 / +1.0% 408402474 / 405727699 / +0.7% 0.83 / 0.83 / +0.3%
tpch_q20/duckdb:vortex-file-compressed 408568768 / 401447444 / +1.8% 512881548 / 492311641 / +4.2% 0.80 / 0.82 / -2.3%
tpch_q21/duckdb:vortex-file-compressed 617406293 / 725227318 / -14.9% 749551942 / 717501071 / +4.5% 0.82 / 1.01 / -18.5%
tpch_q22/duckdb:vortex-file-compressed 113964462 / 113899964 / +0.1% 147754147 / 172025062 / -14.1% 0.77 / 0.66 / +16.5%
duckdb / parquet / ns (1.010x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 337302376 / 339101231 / -0.5% 322502216 / 380726538 / -15.3% 1.05 / 0.89 / +17.4%
tpch_q02/duckdb:parquet 704161301 / 673954603 / +4.5% 655050972 / 791803408 / -17.3% 1.07 / 0.85 / +26.3%
tpch_q03/duckdb:parquet 781672257 / 781004432 / +0.1% 826733796 / 987492287 / -16.3% 0.95 / 0.79 / +19.5%
tpch_q04/duckdb:parquet 493352611 / 519261422 / -5.0% 488109185 / 712510927 / -31.5% 🟢 1.01 / 0.73 / +38.7%
tpch_q05/duckdb:parquet 953804553 / 936568628 / +1.8% 903606965 / 1023169678 / -11.7% 1.06 / 0.92 / +15.3%
tpch_q06/duckdb:parquet 320304667 / 328058055 / -2.4% 347646130 / 366651050 / -5.2% 0.92 / 0.89 / +3.0%
tpch_q07/duckdb:parquet 931454783 / 873661859 / +6.6% 942879956 / 866341634 / +8.8% 0.99 / 1.01 / -2.0%
tpch_q08/duckdb:parquet 1118170147 / 1112948233 / +0.5% 1384293301 / 1274155111 / +8.6% 0.81 / 0.87 / -7.5%
tpch_q09/duckdb:parquet 1112360477 / 1045325280 / +6.4% 992950998 / 1080338647 / -8.1% 1.12 / 0.97 / +15.8%
tpch_q10/duckdb:parquet 1141760850 / 1078794154 / +5.8% 1061896633 / 1086374845 / -2.3% 1.08 / 0.99 / +8.3%
tpch_q11/duckdb:parquet 465271619 / 451264106 / +3.1% 494503382 / 470177585 / +5.2% 0.94 / 0.96 / -2.0%
tpch_q12/duckdb:parquet 556157374 / 530886615 / +4.8% 994657969 / 679894953 / +46.3% 🔴 0.56 / 0.78 / -28.4%
tpch_q13/duckdb:parquet 826015376 / 870724137 / -5.1% 874483368 / 998736252 / -12.4% 0.94 / 0.87 / +8.3%
tpch_q14/duckdb:parquet 518375931 / 526184879 / -1.5% 455983315 / 536361678 / -15.0% 1.14 / 0.98 / +15.9%
tpch_q15/duckdb:parquet 385913642 / 402306277 / -4.1% 408492882 / 400823308 / +1.9% 0.94 / 1.00 / -5.9%
tpch_q16/duckdb:parquet 510939647 / 547989131 / -6.8% 674223410 / 546173067 / +23.4% 0.76 / 1.00 / -24.5%
tpch_q17/duckdb:parquet 508652706 / 466017219 / +9.1% 490204298 / 661016191 / -25.8% 1.04 / 0.71 / +47.2%
tpch_q18/duckdb:parquet 655787401 / 659138673 / -0.5% 804449949 / 704579109 / +14.2% 0.82 / 0.94 / -12.9%
tpch_q19/duckdb:parquet 598206641 / 561681552 / +6.5% 606646580 / 662608762 / -8.4% 0.99 / 0.85 / +16.3%
tpch_q20/duckdb:parquet 844178564 / 851735077 / -0.9% 794238481 / 813421376 / -2.4% 1.06 / 1.05 / +1.5%
tpch_q21/duckdb:parquet 772552667 / 755507088 / +2.3% 770212015 / 747443092 / +3.0% 1.00 / 1.01 / -0.8%
tpch_q22/duckdb:parquet 468250463 / 475550601 / -1.5% 466204661 / 642323569 / -27.4% 1.00 / 0.74 / +35.7%

@mhk197 mhk197 changed the title Crop elements before filtering wide list arrays Slice elements and mask to first and last selected index before filtering wide list arrays Aug 27, 2026
@mhk197 mhk197 changed the title Slice elements and mask to first and last selected index before filtering wide list arrays Conditionally slice elements to selected index bounds before filtering wide list arrays Aug 27, 2026
@mhk197
mhk197 force-pushed the mk/crop-list-filter-elements branch from 0df99f1 to c0fbe2a Compare August 28, 2026 14:04
@mhk197
mhk197 changed the base branch from develop to mk/list-filter-benchmark August 28, 2026 14:04
@mhk197
mhk197 force-pushed the mk/crop-list-filter-elements branch 2 times, most recently from dba7820 to ff9eddd Compare August 28, 2026 14:23
@mhk197 mhk197 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 28, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 28, 2026

@connortsui20 connortsui20 left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could you add a comment that explains the algorithm here at a higher level, literally just "if the lists are very long then we should do a cheap slice first before performing a potentially very expensive filter with a large mask" or something

@mhk197
mhk197 force-pushed the mk/crop-list-filter-elements branch from ff9eddd to 6ac2e0c Compare August 28, 2026 14:56
Base automatically changed from mk/list-filter-benchmark to develop August 28, 2026 18:13
mhk197 added 4 commits August 28, 2026 14:13
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
mhk197 added 3 commits August 28, 2026 14:13
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
@mhk197
mhk197 force-pushed the mk/crop-list-filter-elements branch from 3a40b1e to 6873b0d Compare August 28, 2026 18:13
Signed-off-by: Matt Katz <mhkatz97@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants