Simplify `ListLayout` and enable for benchmarks by mhk197 · Pull Request #9675 · vortex-data/vortex

mhk197 · 2026-08-27T18:06:40Z

Summary

Chunk list columns externally in outer-row space and write one ListLayout per already-compressed page.
Keep elements, offsets, and validity as direct flat leaves. reject recursive or chunked ListLayout children.
Stop ListLayout from contributing element-derived scan splits.
Preserve nested array encodings, including dictionaries, and use bounded reads only for selective pages with very large element counts.
Preserve the normal flat writer pipeline and replace only its terminal flat layout with a shredded ListLayout.

Local Benchmarks versus flat

PolarSignals / DataFusion: all queries are 0.94x to 1.00x in the longer reruns.
StatPopGen / DuckDB: queries are 0.79x to 1.01x; selective Q7 and Q8 improve to 0.79x and 0.82x.

codspeed-hq · 2026-08-27T18:11:38Z

Merging this PR will regress 6 benchmarks

⚠️

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

⚠️

Different runtime environments detected

Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.

Open the report in CodSpeed to investigate

⚡ 4 improved benchmarks
❌ 6 regressed benchmarks
✅ 2159 untouched benchmarks
⏩ 106 skipped benchmarks¹
🗄️ 4 archived benchmarks run²

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

	Mode	Benchmark	`BASE`	`HEAD`	Efficiency
❌	WallTime	`arrow_checked_add_u32_neon[16384]`	13.4 µs	20.3 µs	-34.06%
❌	WallTime	`arrow_checked_add_u32_avx2[16384]`	17.7 µs	21.3 µs	-16.91%
❌	Simulation	`take_map[(0.1, 1.0)]`	223.4 µs	262.8 µs	-14.99%
❌	Simulation	`take_map[(0.1, 0.5)]`	153.2 µs	173.8 µs	-11.88%
❌	Simulation	`compact[(1024, 90)]`	1.4 µs	1.5 µs	-10.74%
❌	Simulation	`compact[(2048, 90)]`	1.4 µs	1.6 µs	-10.34%
⚡	Simulation	`filter_list_primitive_wide[Sparse]`	823.3 µs	143.5 µs	×5.7
⚡	Simulation	`filter_list_primitive_wide[Clustered]`	821.1 µs	149.1 µs	×5.5
⚡	Simulation	`filter_list_primitive_wide[Prefix]`	754.1 µs	149.9 µs	×5
⚡	WallTime	`arrow_checked_add_u32_avx512[16384]`	21.3 µs	17.7 µs	+20.42%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

_{Comparing mk/simplify-list-layout (d2fc075) with develop (68d6573)³}

106 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
4 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them. ↩
No successful run was found on develop (01f147a) during the generation of this report, so 68d6573 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report. ↩

github-actions · 2026-08-27T18:20:20Z

Polar Signals Profiling Results

Latest Run

Status	Commit	Job	Attempt	Link
🟢 Done	`ff4c187`	statpopgen	1	Explore Profiling Data
🟢 Done	`ff4c187`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`ff4c187`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`ff4c187`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`ff4c187`	fineweb	1	Explore Profiling Data
🟢 Done	`ff4c187`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`ff4c187`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`ff4c187`	polarsignals	1	Explore Profiling Data
🟢 Done	`ff4c187`	tpch-s3	1	Explore Profiling Data
🟢 Done	`ff4c187`	tpch-nvme	1	Explore Profiling Data

Previous Runs (20)

Status	Commit	Job	Attempt	Link
🟢 Done	`20c347d`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`20c347d`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`20c347d`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`20c347d`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`20c347d`	fineweb	1	Explore Profiling Data
🟢 Done	`20c347d`	statpopgen	1	Explore Profiling Data
🟢 Done	`20c347d`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`20c347d`	polarsignals	1	Explore Profiling Data
🟢 Done	`20c347d`	tpch-s3	1	Explore Profiling Data
🟢 Done	`20c347d`	tpch-nvme	1	Explore Profiling Data
🟢 Done	`7fe9106`	statpopgen	1	Explore Profiling Data
🟢 Done	`7fe9106`	clickbench-sorted-nvme	1	Explore Profiling Data
🟢 Done	`7fe9106`	clickbench-nvme	1	Explore Profiling Data
🟢 Done	`7fe9106`	tpch-nvme-10	1	Explore Profiling Data
🟢 Done	`7fe9106`	fineweb	1	Explore Profiling Data
🟢 Done	`7fe9106`	fineweb-s3	1	Explore Profiling Data
🟢 Done	`7fe9106`	tpcds-nvme	1	Explore Profiling Data
🟢 Done	`7fe9106`	polarsignals	1	Explore Profiling Data
🟢 Done	`7fe9106`	tpch-s3	1	Explore Profiling Data
🟢 Done	`7fe9106`	tpch-nvme	1	Explore Profiling Data

Powered by Polar Signals Cloud

github-actions · 2026-08-27T18:22:00Z

Benchmarks: PolarSignals Profiling 📖

Commits: PR ff4c1879 vs base 01f147a5
Vortex (geomean): hot 1.028x ➖ · cold 0.978x ➖

datafusion / vortex-file-compressed / ns (1.028x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed	125792062 / 115264588 / +9.1%	202037215 / 204858081 / -1.4%	0.62 / 0.56 / +10.7%
polarsignals_q01/datafusion:vortex-file-compressed	156351502 / 156528870 / -0.1%	273832459 / 276408405 / -0.9%	0.57 / 0.57 / +0.8%
polarsignals_q02/datafusion:vortex-file-compressed	51308529 / 50242292 / +2.1%	117371195 / 124900216 / -6.0%	0.44 / 0.40 / +8.7%
polarsignals_q03/datafusion:vortex-file-compressed	160367562 / 158569260 / +1.1%	276243792 / 278479224 / -0.8%	0.58 / 0.57 / +2.0%
polarsignals_q04/datafusion:vortex-file-compressed	10459004 / 10463790 / -0.0%	75062488 / 79737674 / -5.9%	0.14 / 0.13 / +6.2%
polarsignals_q05/datafusion:vortex-file-compressed	13265888 / 13456691 / -1.4%	85905898 / 93440660 / -8.1%	0.15 / 0.14 / +7.2%
polarsignals_q06/datafusion:vortex-file-compressed	31563320 / 28926353 / +9.1%	103952619 / 103649495 / +0.3%	0.30 / 0.28 / +8.8%
polarsignals_q07/datafusion:vortex-file-compressed	11513037 / 11356584 / +1.4%	86869332 / 86087344 / +0.9%	0.13 / 0.13 / +0.5%
polarsignals_q08/datafusion:vortex-file-compressed	287181482 / 286908780 / +0.1%	405275174 / 403036817 / +0.6%	0.71 / 0.71 / -0.5%
polarsignals_q09/datafusion:vortex-file-compressed	11318756 / 10561894 / +7.2%	78578486 / 79123146 / -0.7%	0.14 / 0.13 / +7.9%

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)

File	Scale	Format	Base	HEAD	Change	%
stacktraces.vortex	1000000	vortex-file-compressed	631.61 MB	631.67 MB	+54.88 KB	+0.0%

Totals:

vortex-file-compressed: 631.61 MB → 631.67 MB (+0.0%)

github-actions · 2026-08-27T18:23:18Z

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR ff4c1879 vs base 01f147a5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (+0.8%, environment too noisy confidence) · DuckDB No clear signal (+0.7%, low confidence)
Vortex (geomean): hot 1.006x ➖ · cold 1.011x ➖
Parquet (geomean): hot 0.999x ➖ · cold 1.006x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.7%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	42168527 / 45169733 / -6.6%	102510197 / 105827002 / -3.1%	0.41 / 0.43 / -3.6%
tpch_q02/datafusion:vortex-file-compressed	22691293 / 23809220 / -4.7%	67302129 / 69446425 / -3.1%	0.34 / 0.34 / -1.7%
tpch_q03/datafusion:vortex-file-compressed	26685772 / 27263916 / -2.1%	95634466 / 96702328 / -1.1%	0.28 / 0.28 / -1.0%
tpch_q04/datafusion:vortex-file-compressed	14549710 / 15337909 / -5.1%	62919852 / 62111593 / +1.3%	0.23 / 0.25 / -6.4%
tpch_q05/datafusion:vortex-file-compressed	47660270 / 47010049 / +1.4%	120973026 / 122093721 / -0.9%	0.39 / 0.39 / +2.3%
tpch_q06/datafusion:vortex-file-compressed	8049629 / 8038912 / +0.1%	58137255 / 57567942 / +1.0%	0.14 / 0.14 / -0.8%
tpch_q07/datafusion:vortex-file-compressed	55747990 / 56869870 / -2.0%	130322147 / 127914374 / +1.9%	0.43 / 0.44 / -3.8%
tpch_q08/datafusion:vortex-file-compressed	45514685 / 45845638 / -0.7%	116926663 / 115947863 / +0.8%	0.39 / 0.40 / -1.6%
tpch_q09/datafusion:vortex-file-compressed	54789749 / 54386280 / +0.7%	132103119 / 132689738 / -0.4%	0.41 / 0.41 / +1.2%
tpch_q10/datafusion:vortex-file-compressed	27475459 / 27517665 / -0.2%	99918247 / 95252040 / +4.9%	0.27 / 0.29 / -4.8%
tpch_q11/datafusion:vortex-file-compressed	18237039 / 17811385 / +2.4%	62783807 / 65609353 / -4.3%	0.29 / 0.27 / +7.0%
tpch_q12/datafusion:vortex-file-compressed	24864845 / 24289860 / +2.4%	76803528 / 76249923 / +0.7%	0.32 / 0.32 / +1.6%
tpch_q13/datafusion:vortex-file-compressed	23867048 / 23658863 / +0.9%	76998350 / 75183705 / +2.4%	0.31 / 0.31 / -1.5%
tpch_q14/datafusion:vortex-file-compressed	15998229 / 16217001 / -1.3%	74512783 / 71634786 / +4.0%	0.21 / 0.23 / -5.2%
tpch_q15/datafusion:vortex-file-compressed	20590488 / 21547005 / -4.4%	79872618 / 77413417 / +3.2%	0.26 / 0.28 / -7.4%
tpch_q16/datafusion:vortex-file-compressed	22709043 / 22808752 / -0.4%	73773862 / 75298286 / -2.0%	0.31 / 0.30 / +1.6%
tpch_q17/datafusion:vortex-file-compressed	55712136 / 54607608 / +2.0%	123005542 / 124241260 / -1.0%	0.45 / 0.44 / +3.0%
tpch_q18/datafusion:vortex-file-compressed	63775531 / 63177811 / +0.9%	119050193 / 118497552 / +0.5%	0.54 / 0.53 / +0.5%
tpch_q19/datafusion:vortex-file-compressed	15872270 / 15340653 / +3.5%	71768903 / 68698268 / +4.5%	0.22 / 0.22 / -1.0%
tpch_q20/datafusion:vortex-file-compressed	26620839 / 26037353 / +2.2%	88183528 / 90340292 / -2.4%	0.30 / 0.29 / +4.7%
tpch_q21/datafusion:vortex-file-compressed	58376359 / 57868426 / +0.9%	139235597 / 138853418 / +0.3%	0.42 / 0.42 / +0.6%
tpch_q22/datafusion:vortex-file-compressed	13903899 / 13781875 / +0.9%	60944276 / 62918553 / -3.1%	0.23 / 0.22 / +4.2%

datafusion / parquet / ns (0.988x ➖, 3↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	119109110 / 132551117 / -10.1% 🟢	145031952 / 145635873 / -0.4%	0.82 / 0.91 / -9.8%
tpch_q02/datafusion:parquet	68299063 / 67991828 / +0.5%	112394856 / 116609081 / -3.6%	0.61 / 0.58 / +4.2%
tpch_q03/datafusion:parquet	86835696 / 88417373 / -1.8%	154207462 / 166622036 / -7.5%	0.56 / 0.53 / +6.1%
tpch_q04/datafusion:parquet	49600025 / 48676561 / +1.9%	105953069 / 99346689 / +6.6%	0.47 / 0.49 / -4.5%
tpch_q05/datafusion:parquet	108973176 / 105131795 / +3.7%	183198434 / 172173620 / +6.4%	0.59 / 0.61 / -2.6%
tpch_q06/datafusion:parquet	38542503 / 48019674 / -19.7% 🟢	94575801 / 95215912 / -0.7%	0.41 / 0.50 / -19.2%
tpch_q07/datafusion:parquet	109458394 / 112255847 / -2.5%	180008374 / 191708467 / -6.1%	0.61 / 0.59 / +3.8%
tpch_q08/datafusion:parquet	105994838 / 105173736 / +0.8%	183726634 / 172889817 / +6.3%	0.58 / 0.61 / -5.2%
tpch_q09/datafusion:parquet	134285256 / 131906331 / +1.8%	224696216 / 213207623 / +5.4%	0.60 / 0.62 / -3.4%
tpch_q10/datafusion:parquet	115348166 / 113188973 / +1.9%	184550180 / 181783823 / +1.5%	0.63 / 0.62 / +0.4%
tpch_q11/datafusion:parquet	49924305 / 49168383 / +1.5%	102067381 / 104712588 / -2.5%	0.49 / 0.47 / +4.2%
tpch_q12/datafusion:parquet	84502953 / 82928110 / +1.9%	153998454 / 148136240 / +4.0%	0.55 / 0.56 / -2.0%
tpch_q13/datafusion:parquet	211400938 / 212271372 / -0.4%	266008934 / 262348808 / +1.4%	0.79 / 0.81 / -1.8%
tpch_q14/datafusion:parquet	47911996 / 52281114 / -8.4%	103628694 / 109002643 / -4.9%	0.46 / 0.48 / -3.6%
tpch_q15/datafusion:parquet	66986133 / 61598118 / +8.7%	113165142 / 121293336 / -6.7%	0.59 / 0.51 / +16.6%
tpch_q16/datafusion:parquet	52761876 / 51298928 / +2.9%	100747983 / 103175271 / -2.4%	0.52 / 0.50 / +5.3%
tpch_q17/datafusion:parquet	149910442 / 139299552 / +7.6%	220043073 / 212465632 / +3.6%	0.68 / 0.66 / +3.9%
tpch_q18/datafusion:parquet	169141072 / 160232078 / +5.6%	213231823 / 210775674 / +1.2%	0.79 / 0.76 / +4.3%
tpch_q19/datafusion:parquet	75112901 / 88579629 / -15.2% 🟢	154519264 / 147236200 / +4.9%	0.49 / 0.60 / -19.2%
tpch_q20/datafusion:parquet	72552855 / 75552990 / -4.0%	136842489 / 142615490 / -4.0%	0.53 / 0.53 / +0.1%
tpch_q21/datafusion:parquet	132052777 / 133292952 / -0.9%	209059020 / 204088505 / +2.4%	0.63 / 0.65 / -3.3%
tpch_q22/datafusion:parquet	55923189 / 54499266 / +2.6%	93772822 / 105233802 / -10.9% 🟢	0.60 / 0.52 / +15.2%

duckdb / vortex-file-compressed / ns (1.018x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	24892624 / 22853636 / +8.9%	69900964 / 60979916 / +14.6% 🔴	0.36 / 0.37 / -5.0%
tpch_q02/duckdb:vortex-file-compressed	30167904 / 29979714 / +0.6%	53600828 / 47037802 / +14.0% 🔴	0.56 / 0.64 / -11.7%
tpch_q03/duckdb:vortex-file-compressed	34911856 / 34950330 / -0.1%	82510232 / 75859694 / +8.8%	0.42 / 0.46 / -8.2%
tpch_q04/duckdb:vortex-file-compressed	31461387 / 31086472 / +1.2%	62776678 / 69660248 / -9.9%	0.50 / 0.45 / +12.3%
tpch_q05/duckdb:vortex-file-compressed	42450573 / 42243705 / +0.5%	83266815 / 81916503 / +1.6%	0.51 / 0.52 / -1.1%
tpch_q06/duckdb:vortex-file-compressed	11153396 / 9278295 / +20.2% 🔴	36790621 / 41571196 / -11.5% 🟢	0.30 / 0.22 / +35.8%
tpch_q07/duckdb:vortex-file-compressed	39365692 / 38933662 / +1.1%	83639893 / 82866312 / +0.9%	0.47 / 0.47 / +0.2%
tpch_q08/duckdb:vortex-file-compressed	45616196 / 46554639 / -2.0%	86143321 / 91192822 / -5.5%	0.53 / 0.51 / +3.7%
tpch_q09/duckdb:vortex-file-compressed	59547123 / 55964856 / +6.4%	108723472 / 109973004 / -1.1%	0.55 / 0.51 / +7.6%
tpch_q10/duckdb:vortex-file-compressed	48206379 / 50240928 / -4.0%	94569144 / 89349583 / +5.8%	0.51 / 0.56 / -9.3%
tpch_q11/duckdb:vortex-file-compressed	17325533 / 16662851 / +4.0%	36152639 / 34840754 / +3.8%	0.48 / 0.48 / +0.2%
tpch_q12/duckdb:vortex-file-compressed	27690501 / 26274873 / +5.4%	63709765 / 59793045 / +6.6%	0.43 / 0.44 / -1.1%
tpch_q13/duckdb:vortex-file-compressed	42036929 / 44253435 / -5.0%	114328421 / 116166530 / -1.6%	0.37 / 0.38 / -3.5%
tpch_q14/duckdb:vortex-file-compressed	20979877 / 21688851 / -3.3%	56941483 / 60878620 / -6.5%	0.37 / 0.36 / +3.4%
tpch_q15/duckdb:vortex-file-compressed	17855408 / 17421270 / +2.5%	60516844 / 53940976 / +12.2% 🔴	0.30 / 0.32 / -8.6%
tpch_q16/duckdb:vortex-file-compressed	31343069 / 31499372 / -0.5%	44940783 / 44850975 / +0.2%	0.70 / 0.70 / -0.7%
tpch_q17/duckdb:vortex-file-compressed	32001803 / 32110375 / -0.3%	84562987 / 82967535 / +1.9%	0.38 / 0.39 / -2.2%
tpch_q18/duckdb:vortex-file-compressed	50222067 / 48926209 / +2.6%	85173291 / 75210929 / +13.2% 🔴	0.59 / 0.65 / -9.4%
tpch_q19/duckdb:vortex-file-compressed	36486688 / 38203877 / -4.5%	73698348 / 70831747 / +4.0%	0.50 / 0.54 / -8.2%
tpch_q20/duckdb:vortex-file-compressed	34862998 / 32458439 / +7.4%	85718978 / 86671936 / -1.1%	0.41 / 0.37 / +8.6%
tpch_q21/duckdb:vortex-file-compressed	116652218 / 118371904 / -1.5%	171454883 / 156900929 / +9.3%	0.68 / 0.75 / -9.8%
tpch_q22/duckdb:vortex-file-compressed	21077123 / 20651510 / +2.1%	39073210 / 42269600 / -7.6%	0.54 / 0.49 / +10.4%

duckdb / parquet / ns (1.010x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	81757582 / 81689740 / +0.1%	94587888 / 93105200 / +1.6%	0.86 / 0.88 / -1.5%
tpch_q02/duckdb:parquet	46740013 / 46090624 / +1.4%	63631009 / 60314693 / +5.5%	0.73 / 0.76 / -3.9%
tpch_q03/duckdb:parquet	81054723 / 80996495 / +0.1%	100979978 / 100168008 / +0.8%	0.80 / 0.81 / -0.7%
tpch_q04/duckdb:parquet	58437625 / 57856984 / +1.0%	74907174 / 75381201 / -0.6%	0.78 / 0.77 / +1.6%
tpch_q05/duckdb:parquet	78694160 / 78604227 / +0.1%	102465881 / 101092155 / +1.4%	0.77 / 0.78 / -1.2%
tpch_q06/duckdb:parquet	25198925 / 24974668 / +0.9%	34595932 / 33189144 / +4.2%	0.73 / 0.75 / -3.2%
tpch_q07/duckdb:parquet	79902311 / 79506185 / +0.5%	102411472 / 99454512 / +3.0%	0.78 / 0.80 / -2.4%
tpch_q08/duckdb:parquet	97045600 / 95726480 / +1.4%	122037611 / 119600621 / +2.0%	0.80 / 0.80 / -0.6%
tpch_q09/duckdb:parquet	149216759 / 149127505 / +0.1%	171817387 / 196370743 / -12.5% 🟢	0.87 / 0.76 / +14.4%
tpch_q10/duckdb:parquet	142202603 / 141991457 / +0.1%	167091388 / 163782988 / +2.0%	0.85 / 0.87 / -1.8%
tpch_q11/duckdb:parquet	25533472 / 25398772 / +0.5%	37208830 / 35459645 / +4.9%	0.69 / 0.72 / -4.2%
tpch_q12/duckdb:parquet	53780348 / 53596370 / +0.3%	69603554 / 67973444 / +2.4%	0.77 / 0.79 / -2.0%
tpch_q13/duckdb:parquet	290059206 / 287182166 / +1.0%	313270554 / 306979822 / +2.0%	0.93 / 0.94 / -1.0%
tpch_q14/duckdb:parquet	56245069 / 56210584 / +0.1%	73140123 / 72747244 / +0.5%	0.77 / 0.77 / -0.5%
tpch_q15/duckdb:parquet	31177978 / 30623409 / +1.8%	44539485 / 43455972 / +2.5%	0.70 / 0.70 / -0.7%
tpch_q16/duckdb:parquet	67527045 / 65492559 / +3.1%	83212964 / 84416102 / -1.4%	0.81 / 0.78 / +4.6%
tpch_q17/duckdb:parquet	58866327 / 58539163 / +0.6%	77721304 / 76509605 / +1.6%	0.76 / 0.77 / -1.0%
tpch_q18/duckdb:parquet	128333137 / 128583491 / -0.2%	147538406 / 143300775 / +3.0%	0.87 / 0.90 / -3.1%
tpch_q19/duckdb:parquet	77732114 / 78167073 / -0.6%	98204363 / 96457204 / +1.8%	0.79 / 0.81 / -2.3%
tpch_q20/duckdb:parquet	78541606 / 77624833 / +1.2%	104063681 / 102619678 / +1.4%	0.75 / 0.76 / -0.2%
tpch_q21/duckdb:parquet	207338013 / 191264697 / +8.4%	228091978 / 202836533 / +12.5% 🔴	0.91 / 0.94 / -3.6%
tpch_q22/duckdb:parquet	64926998 / 64485556 / +0.7%	77051969 / 78010091 / -1.2%	0.84 / 0.83 / +1.9%

No file size changes detected.

github-actions · 2026-08-27T18:23:33Z

Benchmarks: FineWeb NVMe 📖

Commits: PR ff4c1879 vs base 01f147a5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.4%
Engines: DataFusion No clear signal (-0.8%, low confidence) · DuckDB No clear signal (+1.6%, low confidence)
Vortex (geomean): hot 1.004x ➖ · cold 1.043x ➖
Parquet (geomean): hot 1.000x ➖ · cold 1.012x ➖
Shifts: Parquet (control) +0.0% · Median polish -0.3%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.993x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	8369718 / 8577154 / -2.4%	40706910 / 35230008 / +15.5% 🔴	0.21 / 0.24 / -15.5%
fineweb_q01/datafusion:vortex-file-compressed	26444692 / 26886740 / -1.6%	98600108 / 94725357 / +4.1%	0.27 / 0.28 / -5.5%
fineweb_q02/datafusion:vortex-file-compressed	29510662 / 28420812 / +3.8%	100980003 / 96189205 / +5.0%	0.29 / 0.30 / -1.1%
fineweb_q03/datafusion:vortex-file-compressed	44863675 / 43151148 / +4.0%	185126398 / 179429093 / +3.2%	0.24 / 0.24 / +0.8%
fineweb_q04/datafusion:vortex-file-compressed	206967075 / 199792684 / +3.6%	317220971 / 324563930 / -2.3%	0.65 / 0.62 / +6.0%
fineweb_q05/datafusion:vortex-file-compressed	151082042 / 154430920 / -2.2%	286078273 / 281140416 / +1.8%	0.53 / 0.55 / -3.9%
fineweb_q06/datafusion:vortex-file-compressed	38434822 / 39938708 / -3.8%	194287657 / 184978454 / +5.0%	0.20 / 0.22 / -8.4%
fineweb_q07/datafusion:vortex-file-compressed	36286373 / 36186096 / +0.3%	191568832 / 184527628 / +3.8%	0.19 / 0.20 / -3.4%
fineweb_q08/datafusion:vortex-file-compressed	19085094 / 20538818 / -7.1%	77448101 / 82308158 / -5.9%	0.25 / 0.25 / -1.2%

datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	9159614 / 8803116 / +4.0%	55585989 / 51362359 / +8.2%	0.16 / 0.17 / -3.9%
fineweb_q01/datafusion:parquet	189170560 / 189564884 / -0.2%	280813647 / 286842848 / -2.1%	0.67 / 0.66 / +1.9%
fineweb_q02/datafusion:parquet	189167336 / 190336113 / -0.6%	280832269 / 280825220 / +0.0%	0.67 / 0.68 / -0.6%
fineweb_q03/datafusion:parquet	191023952 / 190828170 / +0.1%	289848966 / 282678121 / +2.5%	0.66 / 0.68 / -2.4%
fineweb_q04/datafusion:parquet	209174478 / 208301816 / +0.4%	298094960 / 301275145 / -1.1%	0.70 / 0.69 / +1.5%
fineweb_q05/datafusion:parquet	205044564 / 206918174 / -0.9%	299717816 / 296602495 / +1.1%	0.68 / 0.70 / -1.9%
fineweb_q06/datafusion:parquet	191005391 / 190330084 / +0.4%	281205923 / 286030507 / -1.7%	0.68 / 0.67 / +2.1%
fineweb_q07/datafusion:parquet	190102933 / 189776816 / +0.2%	286863576 / 288297102 / -0.5%	0.66 / 0.66 / +0.7%
fineweb_q08/datafusion:parquet	186345716 / 190319922 / -2.1%	285537177 / 282763827 / +1.0%	0.65 / 0.67 / -3.0%

duckdb / vortex-file-compressed / ns (1.015x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	4434602 / 3644591 / +21.7% 🔴	14945520 / 14877049 / +0.5%	0.30 / 0.24 / +21.1%
fineweb_q01/duckdb:vortex-file-compressed	36384632 / 35802302 / +1.6%	155904801 / 110409576 / +41.2% 🔴	0.23 / 0.32 / -28.0%
fineweb_q02/duckdb:vortex-file-compressed	41061512 / 41312892 / -0.6%	141811859 / 115648391 / +22.6% 🔴	0.29 / 0.36 / -18.9%
fineweb_q03/duckdb:vortex-file-compressed	65293994 / 63995972 / +2.0%	219026834 / 187973000 / +16.5% 🔴	0.30 / 0.34 / -12.4%
fineweb_q04/duckdb:vortex-file-compressed	267231232 / 270276296 / -1.1%	403185862 / 376238594 / +7.2%	0.66 / 0.72 / -7.7%
fineweb_q05/duckdb:vortex-file-compressed	225099722 / 215156002 / +4.6%	323081237 / 321719328 / +0.4%	0.70 / 0.67 / +4.2%
fineweb_q06/duckdb:vortex-file-compressed	60467903 / 67172646 / -10.0%	237648984 / 274303624 / -13.4% 🟢	0.25 / 0.24 / +3.9%
fineweb_q07/duckdb:vortex-file-compressed	63128597 / 61973480 / +1.9%	195675349 / 233263756 / -16.1% 🟢	0.32 / 0.27 / +21.4%
fineweb_q08/duckdb:vortex-file-compressed	26089201 / 27025766 / -3.5%	94730316 / 92877605 / +2.0%	0.28 / 0.29 / -5.4%

duckdb / parquet / ns (0.999x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	34999466 / 36024581 / -2.8%	38538192 / 37336622 / +3.2%	0.91 / 0.96 / -5.9%
fineweb_q01/duckdb:parquet	76817292 / 78934742 / -2.7%	109320144 / 104124775 / +5.0%	0.70 / 0.76 / -7.3%
fineweb_q02/duckdb:parquet	77361587 / 77920075 / -0.7%	105689762 / 106458809 / -0.7%	0.73 / 0.73 / +0.0%
fineweb_q03/duckdb:parquet	207604978 / 208283396 / -0.3%	425587354 / 423182741 / +0.6%	0.49 / 0.49 / -0.9%
fineweb_q04/duckdb:parquet	228201415 / 230410685 / -1.0%	431126519 / 444769855 / -3.1%	0.53 / 0.52 / +2.2%
fineweb_q05/duckdb:parquet	205891999 / 204469098 / +0.7%	425978700 / 406802327 / +4.7%	0.48 / 0.50 / -3.8%
fineweb_q06/duckdb:parquet	144033836 / 143510241 / +0.4%	258552422 / 253417837 / +2.0%	0.56 / 0.57 / -1.6%
fineweb_q07/duckdb:parquet	147171973 / 146965650 / +0.1%	328299643 / 323594046 / +1.5%	0.45 / 0.45 / -1.3%
fineweb_q08/duckdb:parquet	38911794 / 36682542 / +6.1%	40393737 / 39953816 / +1.1%	0.96 / 0.92 / +4.9%

No file size changes detected.

github-actions · 2026-08-27T18:25:43Z

Benchmarks: Clickbench Sorted on NVME 📖

Commits: PR ff4c1879 vs base 68d6573b
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.5%
Engines: DataFusion No clear signal (+0.4%, low confidence) · DuckDB No clear signal (-1.3%, low confidence)
Vortex (geomean): hot 0.982x ➖ · cold 0.984x ➖
Parquet (geomean): hot 0.987x ➖ · cold 1.008x ➖
Shifts: Parquet (control) -1.3% · Median polish +0.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.984x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:vortex-file-compressed	330908148 / 468953759 / -29.4% 🟢	1031481634 / 833801880 / +23.7% 🔴	0.32 / 0.56 / -43.0%
clickbench-sorted_q24/datafusion:vortex-file-compressed	27170434 / 25094837 / +8.3%	85715342 / 87817646 / -2.4%	0.32 / 0.29 / +10.9%
clickbench-sorted_q26/datafusion:vortex-file-compressed	26385477 / 24731619 / +6.7%	90156037 / 94091405 / -4.2%	0.29 / 0.26 / +11.3%
clickbench-sorted_q36/datafusion:vortex-file-compressed	51742658 / 51087772 / +1.3%	127035236 / 125078547 / +1.6%	0.41 / 0.41 / -0.3%
clickbench-sorted_q37/datafusion:vortex-file-compressed	41199510 / 40389566 / +2.0%	108554013 / 110702489 / -1.9%	0.38 / 0.36 / +4.0%
clickbench-sorted_q38/datafusion:vortex-file-compressed	50495390 / 51924458 / -2.8%	114541497 / 110593642 / +3.6%	0.44 / 0.47 / -6.1%
clickbench-sorted_q39/datafusion:vortex-file-compressed	128509286 / 123119721 / +4.4%	199097683 / 192302236 / +3.5%	0.65 / 0.64 / +0.8%
clickbench-sorted_q40/datafusion:vortex-file-compressed	21058952 / 20915632 / +0.7%	84171009 / 80668142 / +4.3%	0.25 / 0.26 / -3.5%
clickbench-sorted_q41/datafusion:vortex-file-compressed	20072518 / 20004544 / +0.3%	83561303 / 80029049 / +4.4%	0.24 / 0.25 / -3.9%
clickbench-sorted_q42/datafusion:vortex-file-compressed	15845407 / 16106116 / -1.6%	73055735 / 67303797 / +8.5%	0.22 / 0.24 / -9.4%

datafusion / parquet / ns (0.980x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/datafusion:parquet	2477765636 / 2506952074 / -1.2%	2908912235 / 2938581142 / -1.0%	0.85 / 0.85 / -0.2%
clickbench-sorted_q24/datafusion:parquet	16847373 / 15972732 / +5.5%	117614343 / 116426349 / +1.0%	0.14 / 0.14 / +4.4%
clickbench-sorted_q26/datafusion:parquet	16422984 / 16723884 / -1.8%	115851552 / 117413391 / -1.3%	0.14 / 0.14 / -0.5%
clickbench-sorted_q36/datafusion:parquet	155269643 / 155497797 / -0.1%	279200844 / 272999257 / +2.3%	0.56 / 0.57 / -2.4%
clickbench-sorted_q37/datafusion:parquet	93578636 / 99082894 / -5.6%	209971746 / 215644506 / -2.6%	0.45 / 0.46 / -3.0%
clickbench-sorted_q38/datafusion:parquet	138437412 / 142127278 / -2.6%	256524321 / 252893766 / +1.4%	0.54 / 0.56 / -4.0%
clickbench-sorted_q39/datafusion:parquet	264230512 / 282560020 / -6.5%	404109572 / 382009986 / +5.8%	0.65 / 0.74 / -11.6%
clickbench-sorted_q40/datafusion:parquet	61426234 / 66190370 / -7.2%	177815565 / 168826477 / +5.3%	0.35 / 0.39 / -11.9%
clickbench-sorted_q41/datafusion:parquet	60831220 / 58339554 / +4.3%	171094379 / 172976806 / -1.1%	0.36 / 0.34 / +5.4%
clickbench-sorted_q42/datafusion:parquet	33429274 / 34893044 / -4.2%	134815326 / 136515666 / -1.2%	0.25 / 0.26 / -3.0%

duckdb / vortex-file-compressed / ns (0.981x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:vortex-file-compressed	117847551 / 116687912 / +1.0%	208984883 / 204252225 / +2.3%	0.56 / 0.57 / -1.3%
clickbench-sorted_q24/duckdb:vortex-file-compressed	30999250 / 32613260 / -4.9%	73632186 / 80069700 / -8.0%	0.42 / 0.41 / +3.4%
clickbench-sorted_q26/duckdb:vortex-file-compressed	28404753 / 27738662 / +2.4%	75698577 / 79134782 / -4.3%	0.38 / 0.35 / +7.0%
clickbench-sorted_q36/duckdb:vortex-file-compressed	73772796 / 74997643 / -1.6%	175204446 / 190809645 / -8.2%	0.42 / 0.39 / +7.1%
clickbench-sorted_q37/duckdb:vortex-file-compressed	58679032 / 61314442 / -4.3%	155886139 / 181236266 / -14.0% 🟢	0.38 / 0.34 / +11.3%
clickbench-sorted_q38/duckdb:vortex-file-compressed	81580165 / 75004771 / +8.8%	164166658 / 183269218 / -10.4% 🟢	0.50 / 0.41 / +21.4%
clickbench-sorted_q39/duckdb:vortex-file-compressed	170429196 / 197704198 / -13.8% 🟢	269336355 / 290911866 / -7.4%	0.63 / 0.68 / -6.9%
clickbench-sorted_q40/duckdb:vortex-file-compressed	33621700 / 32623245 / +3.1%	107780915 / 119186924 / -9.6%	0.31 / 0.27 / +14.0%
clickbench-sorted_q41/duckdb:vortex-file-compressed	32717020 / 34912532 / -6.3%	114558193 / 125489234 / -8.7%	0.29 / 0.28 / +2.7%
clickbench-sorted_q42/duckdb:vortex-file-compressed	28904657 / 29475106 / -1.9%	104790245 / 103825094 / +0.9%	0.28 / 0.28 / -2.8%

duckdb / parquet / ns (0.994x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench-sorted_q23/duckdb:parquet	217896454 / 221112572 / -1.5%	260193300 / 267026102 / -2.6%	0.84 / 0.83 / +1.1%
clickbench-sorted_q24/duckdb:parquet	31722310 / 31775176 / -0.2%	53478531 / 54073548 / -1.1%	0.59 / 0.59 / +0.9%
clickbench-sorted_q26/duckdb:parquet	23937290 / 25332586 / -5.5%	44973774 / 45241929 / -0.6%	0.53 / 0.56 / -4.9%
clickbench-sorted_q36/duckdb:parquet	70340775 / 75374502 / -6.7%	99437655 / 99980912 / -0.5%	0.71 / 0.75 / -6.2%
clickbench-sorted_q37/duckdb:parquet	60081566 / 59002672 / +1.8%	101126885 / 94397209 / +7.1%	0.59 / 0.63 / -4.9%
clickbench-sorted_q38/duckdb:parquet	62789200 / 61685035 / +1.8%	96803661 / 95161040 / +1.7%	0.65 / 0.65 / +0.1%
clickbench-sorted_q39/duckdb:parquet	112072470 / 108830510 / +3.0%	157143215 / 156891821 / +0.2%	0.71 / 0.69 / +2.8%
clickbench-sorted_q40/duckdb:parquet	31717388 / 30544431 / +3.8%	73823105 / 68898073 / +7.1%	0.43 / 0.44 / -3.1%
clickbench-sorted_q41/duckdb:parquet	31698101 / 31135387 / +1.8%	65855608 / 63272741 / +4.1%	0.48 / 0.49 / -2.2%
clickbench-sorted_q42/duckdb:parquet	20710595 / 21598634 / -4.1%	43123536 / 46012603 / -6.3%	0.48 / 0.47 / +2.3%

File Size Changes (100 files changed, +0.0% overall, 60↑ 40↓)

File	Scale	Format	Base	HEAD	Change	%
hits_029.vortex	1.0	vortex-file-compressed	197.42 MB	199.52 MB	+2.10 MB	+1.1%
hits_045.vortex	1.0	vortex-file-compressed	138.63 MB	139.54 MB	+932.19 KB	+0.7%
hits_096.vortex	1.0	vortex-file-compressed	197.57 MB	198.81 MB	+1.25 MB	+0.6%
hits_033.vortex	1.0	vortex-file-compressed	198.12 MB	199.35 MB	+1.23 MB	+0.6%
hits_028.vortex	1.0	vortex-file-compressed	150.79 MB	151.67 MB	+909.41 KB	+0.6%
hits_027.vortex	1.0	vortex-file-compressed	190.26 MB	191.37 MB	+1.10 MB	+0.6%
hits_074.vortex	1.0	vortex-file-compressed	197.62 MB	198.69 MB	+1.07 MB	+0.5%
hits_018.vortex	1.0	vortex-file-compressed	197.94 MB	199.01 MB	+1.07 MB	+0.5%
hits_054.vortex	1.0	vortex-file-compressed	145.99 MB	146.63 MB	+653.09 KB	+0.4%
hits_066.vortex	1.0	vortex-file-compressed	162.29 MB	162.99 MB	+716.70 KB	+0.4%
hits_071.vortex	1.0	vortex-file-compressed	138.61 MB	139.18 MB	+582.99 KB	+0.4%
hits_056.vortex	1.0	vortex-file-compressed	134.46 MB	135.01 MB	+556.94 KB	+0.4%
hits_078.vortex	1.0	vortex-file-compressed	129.99 MB	130.41 MB	+439.20 KB	+0.3%
hits_047.vortex	1.0	vortex-file-compressed	153.46 MB	153.95 MB	+505.50 KB	+0.3%
hits_084.vortex	1.0	vortex-file-compressed	153.61 MB	153.96 MB	+356.31 KB	+0.2%
hits_075.vortex	1.0	vortex-file-compressed	188.34 MB	188.76 MB	+429.93 KB	+0.2%
hits_048.vortex	1.0	vortex-file-compressed	198.66 MB	199.05 MB	+400.14 KB	+0.2%
hits_007.vortex	1.0	vortex-file-compressed	197.98 MB	198.37 MB	+398.14 KB	+0.2%
hits_022.vortex	1.0	vortex-file-compressed	198.47 MB	198.80 MB	+334.84 KB	+0.2%
hits_073.vortex	1.0	vortex-file-compressed	171.87 MB	172.14 MB	+281.19 KB	+0.2%
hits_042.vortex	1.0	vortex-file-compressed	200.19 MB	200.50 MB	+308.77 KB	+0.2%
hits_093.vortex	1.0	vortex-file-compressed	130.67 MB	130.86 MB	+196.19 KB	+0.1%
hits_099.vortex	1.0	vortex-file-compressed	170.94 MB	171.18 MB	+251.32 KB	+0.1%
hits_077.vortex	1.0	vortex-file-compressed	171.69 MB	171.92 MB	+230.29 KB	+0.1%
hits_097.vortex	1.0	vortex-file-compressed	191.77 MB	192.02 MB	+251.64 KB	+0.1%
hits_079.vortex	1.0	vortex-file-compressed	179.86 MB	180.07 MB	+212.26 KB	+0.1%
hits_011.vortex	1.0	vortex-file-compressed	198.52 MB	198.75 MB	+231.41 KB	+0.1%
hits_063.vortex	1.0	vortex-file-compressed	130.75 MB	130.90 MB	+144.99 KB	+0.1%
hits_035.vortex	1.0	vortex-file-compressed	102.29 MB	102.40 MB	+103.38 KB	+0.1%
hits_058.vortex	1.0	vortex-file-compressed	154.11 MB	154.26 MB	+149.26 KB	+0.1%
hits_038.vortex	1.0	vortex-file-compressed	188.95 MB	189.13 MB	+181.87 KB	+0.1%
hits_025.vortex	1.0	vortex-file-compressed	171.70 MB	171.85 MB	+150.55 KB	+0.1%
hits_020.vortex	1.0	vortex-file-compressed	159.08 MB	159.21 MB	+137.03 KB	+0.1%
hits_050.vortex	1.0	vortex-file-compressed	160.02 MB	160.16 MB	+137.16 KB	+0.1%
hits_098.vortex	1.0	vortex-file-compressed	136.60 MB	136.71 MB	+107.34 KB	+0.1%
hits_039.vortex	1.0	vortex-file-compressed	159.94 MB	160.06 MB	+123.50 KB	+0.1%
hits_076.vortex	1.0	vortex-file-compressed	159.89 MB	160.00 MB	+114.89 KB	+0.1%
hits_026.vortex	1.0	vortex-file-compressed	130.46 MB	130.54 MB	+87.86 KB	+0.1%
hits_070.vortex	1.0	vortex-file-compressed	199.17 MB	199.29 MB	+120.76 KB	+0.1%
hits_069.vortex	1.0	vortex-file-compressed	141.62 MB	141.69 MB	+73.88 KB	+0.1%
hits_092.vortex	1.0	vortex-file-compressed	198.91 MB	199.01 MB	+100.84 KB	+0.0%
hits_010.vortex	1.0	vortex-file-compressed	168.15 MB	168.24 MB	+83.86 KB	+0.0%
hits_091.vortex	1.0	vortex-file-compressed	145.99 MB	146.05 MB	+69.27 KB	+0.0%
hits_087.vortex	1.0	vortex-file-compressed	159.98 MB	160.05 MB	+66.27 KB	+0.0%
hits_060.vortex	1.0	vortex-file-compressed	191.97 MB	192.04 MB	+76.05 KB	+0.0%
hits_083.vortex	1.0	vortex-file-compressed	156.10 MB	156.16 MB	+57.05 KB	+0.0%
hits_003.vortex	1.0	vortex-file-compressed	135.64 MB	135.68 MB	+46.78 KB	+0.0%
hits_023.vortex	1.0	vortex-file-compressed	194.26 MB	194.33 MB	+64.88 KB	+0.0%
hits_052.vortex	1.0	vortex-file-compressed	129.92 MB	129.95 MB	+36.11 KB	+0.0%
hits_019.vortex	1.0	vortex-file-compressed	139.66 MB	139.69 MB	+31.10 KB	+0.0%
hits_006.vortex	1.0	vortex-file-compressed	125.68 MB	125.69 MB	+16.27 KB	+0.0%
hits_017.vortex	1.0	vortex-file-compressed	145.77 MB	145.79 MB	+18.78 KB	+0.0%
hits_059.vortex	1.0	vortex-file-compressed	198.48 MB	198.50 MB	+20.89 KB	+0.0%
hits_031.vortex	1.0	vortex-file-compressed	158.52 MB	158.54 MB	+16.28 KB	+0.0%
hits_013.vortex	1.0	vortex-file-compressed	160.23 MB	160.24 MB	+14.88 KB	+0.0%
hits_002.vortex	1.0	vortex-file-compressed	159.99 MB	160.00 MB	+14.12 KB	+0.0%
hits_036.vortex	1.0	vortex-file-compressed	170.68 MB	170.70 MB	+14.65 KB	+0.0%
hits_065.vortex	1.0	vortex-file-compressed	160.29 MB	160.30 MB	+10.91 KB	+0.0%
hits_001.vortex	1.0	vortex-file-compressed	192.25 MB	192.25 MB	+4.76 KB	+0.0%
hits_068.vortex	1.0	vortex-file-compressed	159.46 MB	159.46 MB	+992 B	+0.0%
hits_030.vortex	1.0	vortex-file-compressed	130.93 MB	130.90 MB	23.49 KB	-0.0%
hits_057.vortex	1.0	vortex-file-compressed	158.91 MB	158.86 MB	47.24 KB	-0.0%
hits_064.vortex	1.0	vortex-file-compressed	189.84 MB	189.79 MB	56.88 KB	-0.0%
hits_016.vortex	1.0	vortex-file-compressed	179.40 MB	179.34 MB	58.77 KB	-0.0%
hits_037.vortex	1.0	vortex-file-compressed	176.43 MB	176.37 MB	57.80 KB	-0.0%
hits_061.vortex	1.0	vortex-file-compressed	159.86 MB	159.80 MB	55.15 KB	-0.0%
hits_046.vortex	1.0	vortex-file-compressed	100.67 MB	100.64 MB	35.73 KB	-0.0%
hits_055.vortex	1.0	vortex-file-compressed	198.99 MB	198.91 MB	74.36 KB	-0.0%
hits_051.vortex	1.0	vortex-file-compressed	172.28 MB	172.22 MB	67.38 KB	-0.0%
hits_080.vortex	1.0	vortex-file-compressed	126.20 MB	126.14 MB	60.55 KB	-0.0%
hits_015.vortex	1.0	vortex-file-compressed	130.22 MB	130.15 MB	62.68 KB	-0.0%
hits_086.vortex	1.0	vortex-file-compressed	191.24 MB	191.14 MB	93.49 KB	-0.0%
hits_021.vortex	1.0	vortex-file-compressed	153.45 MB	153.37 MB	82.76 KB	-0.1%
hits_032.vortex	1.0	vortex-file-compressed	153.79 MB	153.67 MB	118.77 KB	-0.1%
hits_034.vortex	1.0	vortex-file-compressed	180.92 MB	180.77 MB	149.21 KB	-0.1%
hits_095.vortex	1.0	vortex-file-compressed	153.53 MB	153.40 MB	137.03 KB	-0.1%
hits_090.vortex	1.0	vortex-file-compressed	191.66 MB	191.49 MB	174.95 KB	-0.1%
hits_053.vortex	1.0	vortex-file-compressed	188.95 MB	188.76 MB	194.58 KB	-0.1%
hits_081.vortex	1.0	vortex-file-compressed	199.68 MB	199.48 MB	208.91 KB	-0.1%
hits_005.vortex	1.0	vortex-file-compressed	166.88 MB	166.70 MB	185.06 KB	-0.1%
hits_082.vortex	1.0	vortex-file-compressed	138.76 MB	138.56 MB	201.34 KB	-0.1%
hits_094.vortex	1.0	vortex-file-compressed	157.93 MB	157.70 MB	239.39 KB	-0.1%
hits_004.vortex	1.0	vortex-file-compressed	130.59 MB	130.39 MB	205.45 KB	-0.2%
hits_089.vortex	1.0	vortex-file-compressed	130.70 MB	130.48 MB	223.07 KB	-0.2%
hits_072.vortex	1.0	vortex-file-compressed	101.84 MB	101.67 MB	181.19 KB	-0.2%
hits_000.vortex	1.0	vortex-file-compressed	130.82 MB	130.59 MB	236.12 KB	-0.2%
hits_008.vortex	1.0	vortex-file-compressed	139.09 MB	138.77 MB	331.21 KB	-0.2%
hits_040.vortex	1.0	vortex-file-compressed	142.86 MB	142.52 MB	348.53 KB	-0.2%
hits_044.vortex	1.0	vortex-file-compressed	199.93 MB	199.40 MB	541.33 KB	-0.3%
hits_041.vortex	1.0	vortex-file-compressed	130.78 MB	130.38 MB	407.19 KB	-0.3%
hits_014.vortex	1.0	vortex-file-compressed	172.09 MB	171.55 MB	550.84 KB	-0.3%
hits_049.vortex	1.0	vortex-file-compressed	190.96 MB	190.34 MB	636.20 KB	-0.3%
hits_009.vortex	1.0	vortex-file-compressed	101.04 MB	100.71 MB	339.14 KB	-0.3%
hits_067.vortex	1.0	vortex-file-compressed	131.27 MB	130.80 MB	490.38 KB	-0.4%
hits_043.vortex	1.0	vortex-file-compressed	126.30 MB	125.81 MB	509.20 KB	-0.4%
hits_024.vortex	1.0	vortex-file-compressed	160.05 MB	159.41 MB	660.27 KB	-0.4%
hits_088.vortex	1.0	vortex-file-compressed	172.24 MB	171.51 MB	752.66 KB	-0.4%
hits_062.vortex	1.0	vortex-file-compressed	170.67 MB	169.90 MB	788.25 KB	-0.5%
hits_085.vortex	1.0	vortex-file-compressed	199.09 MB	197.97 MB	1.11 MB	-0.6%
hits_012.vortex	1.0	vortex-file-compressed	192.13 MB	189.84 MB	2.29 MB	-1.2%

Totals:

vortex-file-compressed: 15.87 GB → 15.88 GB (+0.0%)

github-actions · 2026-08-27T18:27:02Z

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR ff4c1879 vs base 68d6573b
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.2%
Engines: DataFusion No clear signal (+0.8%, low confidence) · DuckDB No clear signal (-0.4%, environment too noisy confidence)
Vortex (geomean): hot 1.001x ➖ · cold 0.993x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.987x ➖
Shifts: Parquet (control) -0.1% · Median polish +0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.006x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed	28241113 / 28924186 / -2.4%	85784134 / 85350612 / +0.5%	0.33 / 0.34 / -2.9%
tpcds_q02/datafusion:vortex-file-compressed	52039678 / 51082241 / +1.9%	102868049 / 102473615 / +0.4%	0.51 / 0.50 / +1.5%
tpcds_q03/datafusion:vortex-file-compressed	15471276 / 15375812 / +0.6%	60658794 / 59612010 / +1.8%	0.26 / 0.26 / -1.1%
tpcds_q04/datafusion:vortex-file-compressed	193787916 / 189232660 / +2.4%	265881718 / 267432316 / -0.6%	0.73 / 0.71 / +3.0%
tpcds_q05/datafusion:vortex-file-compressed	64633378 / 62248401 / +3.8%	126427221 / 125665215 / +0.6%	0.51 / 0.50 / +3.2%
tpcds_q06/datafusion:vortex-file-compressed	26930071 / 27118689 / -0.7%	79487537 / 79558643 / -0.1%	0.34 / 0.34 / -0.6%
tpcds_q07/datafusion:vortex-file-compressed	41668448 / 41628320 / +0.1%	110742991 / 105327052 / +5.1%	0.38 / 0.40 / -4.8%
tpcds_q08/datafusion:vortex-file-compressed	30616872 / 31434136 / -2.6%	83498888 / 87344583 / -4.4%	0.37 / 0.36 / +1.9%
tpcds_q09/datafusion:vortex-file-compressed	25693547 / 24769121 / +3.7%	71289810 / 66245617 / +7.6%	0.36 / 0.37 / -3.6%
tpcds_q10/datafusion:vortex-file-compressed	38090794 / 37556951 / +1.4%	90726388 / 90738759 / -0.0%	0.42 / 0.41 / +1.4%
tpcds_q11/datafusion:vortex-file-compressed	106093258 / 106664710 / -0.5%	172324772 / 178098114 / -3.2%	0.62 / 0.60 / +2.8%
tpcds_q12/datafusion:vortex-file-compressed	20131562 / 19491164 / +3.3%	62374789 / 64963020 / -4.0%	0.32 / 0.30 / +7.6%
tpcds_q13/datafusion:vortex-file-compressed	40861440 / 41914713 / -2.5%	97403182 / 99751350 / -2.4%	0.42 / 0.42 / -0.2%
tpcds_q14/datafusion:vortex-file-compressed	142626298 / 140036960 / +1.8%	209214965 / 212210327 / -1.4%	0.68 / 0.66 / +3.3%
tpcds_q15/datafusion:vortex-file-compressed	29418736 / 29197585 / +0.8%	81187598 / 84791391 / -4.3%	0.36 / 0.34 / +5.2%
tpcds_q16/datafusion:vortex-file-compressed	25937398 / 26207234 / -1.0%	74816030 / 74580021 / +0.3%	0.35 / 0.35 / -1.3%
tpcds_q17/datafusion:vortex-file-compressed	67189643 / 66027418 / +1.8%	144316301 / 138536125 / +4.2%	0.47 / 0.48 / -2.3%
tpcds_q18/datafusion:vortex-file-compressed	80641704 / 82454472 / -2.2%	154235834 / 148827504 / +3.6%	0.52 / 0.55 / -5.6%
tpcds_q19/datafusion:vortex-file-compressed	24370654 / 23546289 / +3.5%	74399371 / 77931645 / -4.5%	0.33 / 0.30 / +8.4%
tpcds_q20/datafusion:vortex-file-compressed	25231885 / 24087202 / +4.8%	70109555 / 76150563 / -7.9%	0.36 / 0.32 / +13.8%
tpcds_q21/datafusion:vortex-file-compressed	28892126 / 27876816 / +3.6%	84847806 / 84252977 / +0.7%	0.34 / 0.33 / +2.9%
tpcds_q22/datafusion:vortex-file-compressed	113501366 / 117678142 / -3.5%	188890596 / 135990486 / +38.9% 🔴	0.60 / 0.87 / -30.6%
tpcds_q23/datafusion:vortex-file-compressed	127466139 / 127922594 / -0.4%	203595155 / 198827214 / +2.4%	0.63 / 0.64 / -2.7%
tpcds_q24/datafusion:vortex-file-compressed	82203976 / 83563918 / -1.6%	151356285 / 149020224 / +1.6%	0.54 / 0.56 / -3.1%
tpcds_q25/datafusion:vortex-file-compressed	65851216 / 64904465 / +1.5%	135217357 / 136189610 / -0.7%	0.49 / 0.48 / +2.2%
tpcds_q26/datafusion:vortex-file-compressed	36700280 / 36907452 / -0.6%	94040930 / 95983201 / -2.0%	0.39 / 0.38 / +1.5%
tpcds_q27/datafusion:vortex-file-compressed	93446792 / 90054814 / +3.8%	171422658 / 168995864 / +1.4%	0.55 / 0.53 / +2.3%
tpcds_q28/datafusion:vortex-file-compressed	22849738 / 23568801 / -3.1%	70410989 / 73474496 / -4.2%	0.32 / 0.32 / +1.2%
tpcds_q29/datafusion:vortex-file-compressed	67649024 / 68061148 / -0.6%	125936853 / 130793518 / -3.7%	0.54 / 0.52 / +3.2%
tpcds_q30/datafusion:vortex-file-compressed	35547244 / 34313230 / +3.6%	80828700 / 82198537 / -1.7%	0.44 / 0.42 / +5.4%
tpcds_q31/datafusion:vortex-file-compressed	73521448 / 74487410 / -1.3%	144373656 / 140170571 / +3.0%	0.51 / 0.53 / -4.2%
tpcds_q32/datafusion:vortex-file-compressed	18488894 / 17625355 / +4.9%	58873377 / 62481460 / -5.8%	0.31 / 0.28 / +11.3%
tpcds_q33/datafusion:vortex-file-compressed	33484440 / 33240270 / +0.7%	86056989 / 90146052 / -4.5%	0.39 / 0.37 / +5.5%
tpcds_q34/datafusion:vortex-file-compressed	24346398 / 26446132 / -7.9%	74605376 / 76400799 / -2.4%	0.33 / 0.35 / -5.7%
tpcds_q35/datafusion:vortex-file-compressed	48101423 / 48843161 / -1.5%	101338916 / 103455431 / -2.0%	0.47 / 0.47 / +0.5%
tpcds_q36/datafusion:vortex-file-compressed	58826342 / 60514136 / -2.8%	125238324 / 129535809 / -3.3%	0.47 / 0.47 / +0.5%
tpcds_q37/datafusion:vortex-file-compressed	17760256 / 17259849 / +2.9%	60818031 / 63678877 / -4.5%	0.29 / 0.27 / +7.7%
tpcds_q38/datafusion:vortex-file-compressed	39403002 / 39437397 / -0.1%	95410935 / 93950360 / +1.6%	0.41 / 0.42 / -1.6%
tpcds_q39/datafusion:vortex-file-compressed	94351678 / 94327720 / +0.0%	156676274 / 155626366 / +0.7%	0.60 / 0.61 / -0.6%
tpcds_q40/datafusion:vortex-file-compressed	31545034 / 32119062 / -1.8%	91028228 / 89143951 / +2.1%	0.35 / 0.36 / -3.8%
tpcds_q41/datafusion:vortex-file-compressed	18654916 / 18713042 / -0.3%	59062718 / 57943075 / +1.9%	0.32 / 0.32 / -2.2%
tpcds_q42/datafusion:vortex-file-compressed	13892542 / 14246672 / -2.5%	56039992 / 56913450 / -1.5%	0.25 / 0.25 / -1.0%
tpcds_q43/datafusion:vortex-file-compressed	18674934 / 18186611 / +2.7%	64660843 / 66635612 / -3.0%	0.29 / 0.27 / +5.8%
tpcds_q44/datafusion:vortex-file-compressed	33011636 / 33700532 / -2.0%	86326082 / 86872405 / -0.6%	0.38 / 0.39 / -1.4%
tpcds_q45/datafusion:vortex-file-compressed	32752982 / 31539326 / +3.8%	85240312 / 90238091 / -5.5%	0.38 / 0.35 / +9.9%
tpcds_q46/datafusion:vortex-file-compressed	32527615 / 32056060 / +1.5%	96444962 / 95279605 / +1.2%	0.34 / 0.34 / +0.2%
tpcds_q47/datafusion:vortex-file-compressed	119357384 / 118983860 / +0.3%	188474741 / 192730028 / -2.2%	0.63 / 0.62 / +2.6%
tpcds_q48/datafusion:vortex-file-compressed	32522664 / 32566188 / -0.1%	86561221 / 87524644 / -1.1%	0.38 / 0.37 / +1.0%
tpcds_q49/datafusion:vortex-file-compressed	62560400 / 61916594 / +1.0%	125191838 / 125129477 / +0.0%	0.50 / 0.49 / +1.0%
tpcds_q50/datafusion:vortex-file-compressed	42172134 / 42597762 / -1.0%	100942961 / 103396557 / -2.4%	0.42 / 0.41 / +1.4%
tpcds_q51/datafusion:vortex-file-compressed	71555002 / 71779688 / -0.3%	134844206 / 138169914 / -2.4%	0.53 / 0.52 / +2.1%
tpcds_q52/datafusion:vortex-file-compressed	14286886 / 13814218 / +3.4%	58829286 / 58910206 / -0.1%	0.24 / 0.23 / +3.6%
tpcds_q53/datafusion:vortex-file-compressed	22098416 / 21443896 / +3.1%	72672532 / 75269978 / -3.5%	0.30 / 0.28 / +6.7%
tpcds_q54/datafusion:vortex-file-compressed	37802508 / 37097278 / +1.9%	93751977 / 92908862 / +0.9%	0.40 / 0.40 / +1.0%
tpcds_q55/datafusion:vortex-file-compressed	13868291 / 14220514 / -2.5%	54125765 / 57250444 / -5.5%	0.26 / 0.25 / +3.2%
tpcds_q56/datafusion:vortex-file-compressed	33033752 / 32598552 / +1.3%	91523090 / 90663657 / +0.9%	0.36 / 0.36 / +0.4%
tpcds_q57/datafusion:vortex-file-compressed	96542608 / 93653082 / +3.1%	168011108 / 154807329 / +8.5%	0.57 / 0.60 / -5.0%
tpcds_q58/datafusion:vortex-file-compressed	54001984 / 53533314 / +0.9%	120118279 / 119100502 / +0.9%	0.45 / 0.45 / +0.0%
tpcds_q59/datafusion:vortex-file-compressed	52253154 / 51605950 / +1.3%	106256525 / 109074660 / -2.6%	0.49 / 0.47 / +3.9%
tpcds_q60/datafusion:vortex-file-compressed	33270624 / 32956426 / +1.0%	88403708 / 94282572 / -6.2%	0.38 / 0.35 / +7.7%
tpcds_q61/datafusion:vortex-file-compressed	38067046 / 38039192 / +0.1%	96686990 / 102698540 / -5.9%	0.39 / 0.37 / +6.3%
tpcds_q62/datafusion:vortex-file-compressed	24347420 / 23279266 / +4.6%	71328715 / 71678351 / -0.5%	0.34 / 0.32 / +5.1%
tpcds_q63/datafusion:vortex-file-compressed	22240358 / 21945778 / +1.3%	74405537 / 71147032 / +4.6%	0.30 / 0.31 / -3.1%
tpcds_q64/datafusion:vortex-file-compressed	368389921 / 367354932 / +0.3%	480053576 / 485972655 / -1.2%	0.77 / 0.76 / +1.5%
tpcds_q65/datafusion:vortex-file-compressed	65168824 / 65771686 / -0.9%	125252247 / 129797234 / -3.5%	0.52 / 0.51 / +2.7%
tpcds_q66/datafusion:vortex-file-compressed	72336547 / 71656898 / +0.9%	135593553 / 135628021 / -0.0%	0.53 / 0.53 / +1.0%
tpcds_q67/datafusion:vortex-file-compressed	114340164 / 113406868 / +0.8%	196840629 / 185071416 / +6.4%	0.58 / 0.61 / -5.2%
tpcds_q68/datafusion:vortex-file-compressed	30510003 / 30613594 / -0.3%	95089823 / 101242182 / -6.1%	0.32 / 0.30 / +6.1%
tpcds_q69/datafusion:vortex-file-compressed	38175524 / 37903430 / +0.7%	83997757 / 90544492 / -7.2%	0.45 / 0.42 / +8.6%
tpcds_q70/datafusion:vortex-file-compressed	109434187 / 109264166 / +0.2%	169554521 / 172202324 / -1.5%	0.65 / 0.63 / +1.7%
tpcds_q71/datafusion:vortex-file-compressed	24622710 / 23851158 / +3.2%	`7588315` / 76408339 / -0.7%	0.32 / 0.31 / +3.9%
tpcds_q72/datafusion:vortex-file-compressed	1450799290 / 1438267783 / +0.9%	1516089933 / 1547114120 / -2.0%	0.96 / 0.93 / +2.9%
tpcds_q73/datafusion:vortex-file-compressed	23533316 / 23148202 / +1.7%	76080100 / 76475763 / -0.5%	0.31 / 0.30 / +2.2%
tpcds_q74/datafusion:vortex-file-compressed	69781342 / 70436560 / -0.9%	129261861 / 136184055 / -5.1%	0.54 / 0.52 / +4.4%
tpcds_q75/datafusion:vortex-file-compressed	131272108 / 133295410 / -1.5%	215362261 / 220732002 / -2.4%	0.61 / 0.60 / +0.9%
tpcds_q76/datafusion:vortex-file-compressed	38908944 / 39984243 / -2.7%	95115479 / 95564073 / -0.5%	0.41 / 0.42 / -2.2%
tpcds_q77/datafusion:vortex-file-compressed	41886473 / 41071442 / +2.0%	101693637 / 104992629 / -3.1%	0.41 / 0.39 / +5.3%
tpcds_q78/datafusion:vortex-file-compressed	105380455 / 105996600 / -0.6%	176055360 / 175112795 / +0.5%	0.60 / 0.61 / -1.1%
tpcds_q79/datafusion:vortex-file-compressed	28522910 / 27156014 / +5.0%	84926432 / 84405870 / +0.6%	0.34 / 0.32 / +4.4%
tpcds_q80/datafusion:vortex-file-compressed	97356336 / 97805950 / -0.5%	191678985 / 186065750 / +3.0%	0.51 / 0.53 / -3.4%
tpcds_q81/datafusion:vortex-file-compressed	35018076 / 36914913 / -5.1%	79068226 / 86252585 / -8.3%	0.44 / 0.43 / +3.5%
tpcds_q82/datafusion:vortex-file-compressed	18683630 / 18400304 / +1.5%	63038496 / 64093016 / -1.6%	0.30 / 0.29 / +3.2%
tpcds_q83/datafusion:vortex-file-compressed	45579034 / 46815191 / -2.6%	97679467 / 99647711 / -2.0%	0.47 / 0.47 / -0.7%
tpcds_q84/datafusion:vortex-file-compressed	15641884 / 15565955 / +0.5%	56527756 / 56318352 / +0.4%	0.28 / 0.28 / +0.1%
tpcds_q85/datafusion:vortex-file-compressed	64867688 / 63989881 / +1.4%	130939479 / 133954397 / -2.3%	0.50 / 0.48 / +3.7%
tpcds_q86/datafusion:vortex-file-compressed	20163658 / 18896122 / +6.7%	62447666 / 62557057 / -0.2%	0.32 / 0.30 / +6.9%
tpcds_q87/datafusion:vortex-file-compressed	39363950 / 38293416 / +2.8%	94036535 / 90888470 / +3.5%	0.42 / 0.42 / -0.6%
tpcds_q88/datafusion:vortex-file-compressed	51265945 / 50850000 / +0.8%	118433369 / 112022729 / +5.7%	0.43 / 0.45 / -4.6%
tpcds_q89/datafusion:vortex-file-compressed	25369574 / 25959682 / -2.3%	80411647 / 78852089 / +2.0%	0.32 / 0.33 / -4.2%
tpcds_q90/datafusion:vortex-file-compressed	13794626 / 14190093 / -2.8%	54880072 / 54746441 / +0.2%	0.25 / 0.26 / -3.0%
tpcds_q91/datafusion:vortex-file-compressed	22751716 / 22382978 / +1.6%	65714296 / 70007505 / -6.1%	0.35 / 0.32 / +8.3%
tpcds_q92/datafusion:vortex-file-compressed	17380480 / 17165562 / +1.3%	60246158 / 61906567 / -2.7%	0.29 / 0.28 / +4.0%
tpcds_q93/datafusion:vortex-file-compressed	33825137 / 30559435 / +10.7% 🔴	82356734 / 83245876 / -1.1%	0.41 / 0.37 / +11.9%
tpcds_q94/datafusion:vortex-file-compressed	23588792 / 24804338 / -4.9%	68515513 / 68445674 / +0.1%	0.34 / 0.36 / -5.0%
tpcds_q95/datafusion:vortex-file-compressed	52292442 / 52584338 / -0.6%	112352978 / 111375588 / +0.9%	0.47 / 0.47 / -1.4%
tpcds_q96/datafusion:vortex-file-compressed	11475634 / 11920483 / -3.7%	52104834 / 53633542 / -2.9%	0.22 / 0.22 / -0.9%
tpcds_q97/datafusion:vortex-file-compressed	26572376 / 26485469 / +0.3%	82304987 / 82606587 / -0.4%	0.32 / 0.32 / +0.7%
tpcds_q98/datafusion:vortex-file-compressed	23529856 / 21801206 / +7.9%	73660403 / 75482483 / -2.4%	0.32 / 0.29 / +10.6%
tpcds_q99/datafusion:vortex-file-compressed	28512698 / 26408199 / +8.0%	74143391 / 78101950 / -5.1%	0.38 / 0.34 / +13.7%

datafusion / parquet / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet	35618804 / 34827100 / +2.3%	80170295 / 79278588 / +1.1%	0.44 / 0.44 / +1.1%
tpcds_q02/datafusion:parquet	52037825 / 52352502 / -0.6%	93899132 / 103482146 / -9.3%	0.55 / 0.51 / +9.5%
tpcds_q03/datafusion:parquet	21670102 / 21821102 / -0.7%	60486731 / 63316341 / -4.5%	0.36 / 0.34 / +4.0%
tpcds_q04/datafusion:parquet	293799404 / 287787798 / +2.1%	350855866 / 360535861 / -2.7%	0.84 / 0.80 / +4.9%
tpcds_q05/datafusion:parquet	72120498 / 72918920 / -1.1%	138551598 / 137431475 / +0.8%	0.52 / 0.53 / -1.9%
tpcds_q06/datafusion:parquet	37298209 / 38662318 / -3.5%	85434041 / 83842665 / +1.9%	0.44 / 0.46 / -5.3%
tpcds_q07/datafusion:parquet	57163448 / 58134796 / -1.7%	122678399 / 116464645 / +5.3%	0.47 / 0.50 / -6.7%
tpcds_q08/datafusion:parquet	43779332 / 44503400 / -1.6%	90456095 / 92968387 / -2.7%	0.48 / 0.48 / +1.1%
tpcds_q09/datafusion:parquet	31888520 / 33329492 / -4.3%	86619293 / 79730044 / +8.6%	0.37 / 0.42 / -11.9%
tpcds_q10/datafusion:parquet	54647608 / 54362422 / +0.5%	98661520 / 97444865 / +1.2%	0.55 / 0.56 / -0.7%
tpcds_q11/datafusion:parquet	141072379 / 137340496 / +2.7%	200703039 / 197539489 / +1.6%	0.70 / 0.70 / +1.1%
tpcds_q12/datafusion:parquet	29842850 / 28139022 / +6.1%	69571531 / 69871846 / -0.4%	0.43 / 0.40 / +6.5%
tpcds_q13/datafusion:parquet	58841118 / 57516095 / +2.3%	117938812 / 116672226 / +1.1%	0.50 / 0.49 / +1.2%
tpcds_q14/datafusion:parquet	174790786 / 172997132 / +1.0%	226684505 / 229033433 / -1.0%	0.77 / 0.76 / +2.1%
tpcds_q15/datafusion:parquet	30563918 / 30381459 / +0.6%	77251556 / 75939479 / +1.7%	0.40 / 0.40 / -1.1%
tpcds_q16/datafusion:parquet	35708966 / 37086085 / -3.7%	83296196 / 81835280 / +1.8%	0.43 / 0.45 / -5.4%
tpcds_q17/datafusion:parquet	80077078 / 77746040 / +3.0%	156507854 / 156210490 / +0.2%	0.51 / 0.50 / +2.8%
tpcds_q18/datafusion:parquet	64686026 / 65556774 / -1.3%	125452605 / 126903031 / -1.1%	0.52 / 0.52 / -0.2%
tpcds_q19/datafusion:parquet	39902270 / 38950808 / +2.4%	85022185 / 84954518 / +0.1%	0.47 / 0.46 / +2.4%
tpcds_q20/datafusion:parquet	32131704 / 33980506 / -5.4%	71548054 / 77074788 / -7.2%	0.45 / 0.44 / +1.9%
tpcds_q21/datafusion:parquet	24788463 / 25578060 / -3.1%	64847205 / 72072176 / -10.0% 🟢	0.38 / 0.35 / +7.7%
tpcds_q22/datafusion:parquet	113516324 / 109464586 / +3.7%	180587522 / 183665307 / -1.7%	0.63 / 0.60 / +5.5%
tpcds_q23/datafusion:parquet	158855766 / 161403024 / -1.6%	232483303 / 239965934 / -3.1%	0.68 / 0.67 / +1.6%
tpcds_q24/datafusion:parquet	102712358 / 103391836 / -0.7%	172377425 / 170309133 / +1.2%	0.60 / 0.61 / -1.8%
tpcds_q25/datafusion:parquet	79804341 / 80042974 / -0.3%	161623577 / 156531008 / +3.3%	0.49 / 0.51 / -3.4%
tpcds_q26/datafusion:parquet	47172244 / 48390943 / -2.5%	92447948 / 95215024 / -2.9%	0.51 / 0.51 / +0.4%
tpcds_q27/datafusion:parquet	109450611 / 109522950 / -0.1%	194586675 / 200701443 / -3.0%	0.56 / 0.55 / +3.1%
tpcds_q28/datafusion:parquet	36016351 / 35638400 / +1.1%	89125961 / 89373003 / -0.3%	0.40 / 0.40 / +1.3%
tpcds_q29/datafusion:parquet	80441078 / 82048362 / -2.0%	158026714 / 157063678 / +0.6%	0.51 / 0.52 / -2.6%
tpcds_q30/datafusion:parquet	54747027 / 54574446 / +0.3%	102767356 / 107384797 / -4.3%	0.53 / 0.51 / +4.8%
tpcds_q31/datafusion:parquet	93701117 / 93518063 / +0.2%	151118392 / 152820045 / -1.1%	0.62 / 0.61 / +1.3%
tpcds_q32/datafusion:parquet	27385818 / 26596841 / +3.0%	64988689 / 68993049 / -5.8%	0.42 / 0.39 / +9.3%
tpcds_q33/datafusion:parquet	42562082 / 45751076 / -7.0%	93660253 / 94829466 / -1.2%	0.45 / 0.48 / -5.8%
tpcds_q34/datafusion:parquet	30881540 / 30673298 / +0.7%	72106315 / 73688754 / -2.1%	0.43 / 0.42 / +2.9%
tpcds_q35/datafusion:parquet	68402171 / 71788672 / -4.7%	122542476 / 123480755 / -0.8%	0.56 / 0.58 / -4.0%
tpcds_q36/datafusion:parquet	64288075 / 68845975 / -6.6%	137732192 / 141498242 / -2.7%	0.47 / 0.49 / -4.1%
tpcds_q37/datafusion:parquet	25279349 / 25441565 / -0.6%	70453490 / 72384528 / -2.7%	0.36 / 0.35 / +2.1%
tpcds_q38/datafusion:parquet	50369258 / 50557570 / -0.4%	102097227 / 104069219 / -1.9%	0.49 / 0.49 / +1.6%
tpcds_q39/datafusion:parquet	83223451 / 83178488 / +0.1%	138129979 / 139810164 / -1.2%	0.60 / 0.59 / +1.3%
tpcds_q40/datafusion:parquet	32833726 / 32621378 / +0.7%	85938641 / 92621432 / -7.2%	0.38 / 0.35 / +8.5%
tpcds_q41/datafusion:parquet	22487800 / 22312157 / +0.8%	60181025 / 62885063 / -4.3%	0.37 / 0.35 / +5.3%
tpcds_q42/datafusion:parquet	19144098 / 20822044 / -8.1%	58204507 / 58202733 / +0.0%	0.33 / 0.36 / -8.1%
tpcds_q43/datafusion:parquet	25496156 / 24991376 / +2.0%	61253434 / 61887865 / -1.0%	0.42 / 0.40 / +3.1%
tpcds_q44/datafusion:parquet	39151862 / 40737758 / -3.9%	99269354 / 93981100 / +5.6%	0.39 / 0.43 / -9.0%
tpcds_q45/datafusion:parquet	40571448 / 38092380 / +6.5%	90735371 / 93044570 / -2.5%	0.45 / 0.41 / +9.2%
tpcds_q46/datafusion:parquet	39743433 / 39185070 / +1.4%	89316076 / 94629452 / -5.6%	0.44 / 0.41 / +7.5%
tpcds_q47/datafusion:parquet	139275200 / 141780121 / -1.8%	214575383 / 220738703 / -2.8%	0.65 / 0.64 / +1.1%
tpcds_q48/datafusion:parquet	51494486 / 51079076 / +0.8%	106728785 / 104484858 / +2.1%	0.48 / 0.49 / -1.3%
tpcds_q49/datafusion:parquet	75512391 / 77108443 / -2.1%	143954187 / 150994842 / -4.7%	0.52 / 0.51 / +2.7%
tpcds_q50/datafusion:parquet	56712867 / 58213392 / -2.6%	112982964 / 118036305 / -4.3%	0.50 / 0.49 / +1.8%
tpcds_q51/datafusion:parquet	81602342 / 81711954 / -0.1%	142489775 / 140164148 / +1.7%	0.57 / 0.58 / -1.8%
tpcds_q52/datafusion:parquet	20668270 / 19891742 / +3.9%	60665020 / 61550454 / -1.4%	0.34 / 0.32 / +5.4%
tpcds_q53/datafusion:parquet	25709516 / 25766462 / -0.2%	71865835 / 71753670 / +0.2%	0.36 / 0.36 / -0.4%
tpcds_q54/datafusion:parquet	54264902 / 53802966 / +0.9%	101454483 / 98369289 / +3.1%	0.53 / 0.55 / -2.2%
tpcds_q55/datafusion:parquet	19878156 / 20213582 / -1.7%	57784808 / 61884327 / -6.6%	0.34 / 0.33 / +5.3%
tpcds_q56/datafusion:parquet	44638005 / 46842673 / -4.7%	97255935 / 97848867 / -0.6%	0.46 / 0.48 / -4.1%
tpcds_q57/datafusion:parquet	118092454 / 121479565 / -2.8%	180718592 / 182317618 / -0.9%	0.65 / 0.67 / -1.9%
tpcds_q58/datafusion:parquet	73946562 / 73559906 / +0.5%	138711350 / 132826356 / +4.4%	0.53 / 0.55 / -3.7%
tpcds_q59/datafusion:parquet	70505319 / 70288334 / +0.3%	124397455 / 122280755 / +1.7%	0.57 / 0.57 / -1.4%
tpcds_q60/datafusion:parquet	44278529 / 44275206 / +0.0%	101518598 / 96969397 / +4.7%	0.44 / 0.46 / -4.5%
tpcds_q61/datafusion:parquet	51070672 / 48927286 / +4.4%	106951820 / 107758755 / -0.7%	0.48 / 0.45 / +5.2%
tpcds_q62/datafusion:parquet	31430996 / 29568359 / +6.3%	72549225 / 69783920 / +4.0%	0.43 / 0.42 / +2.2%
tpcds_q63/datafusion:parquet	25861893 / 26597214 / -2.8%	77124712 / 75090867 / +2.7%	0.34 / 0.35 / -5.3%
tpcds_q64/datafusion:parquet	277339143 / 277300137 / +0.0%	355622174 / 364708656 / -2.5%	0.78 / 0.76 / +2.6%
tpcds_q65/datafusion:parquet	44468798 / 43274470 / +2.8%	93330635 / 96755244 / -3.5%	0.48 / 0.45 / +6.5%
tpcds_q66/datafusion:parquet	82884961 / 80031402 / +3.6%	132462397 / 138313040 / -4.2%	0.63 / 0.58 / +8.1%
tpcds_q67/datafusion:parquet	131210090 / 135805320 / -3.4%	210786711 / 198187938 / +6.4%	0.62 / 0.69 / -9.2%
tpcds_q68/datafusion:parquet	37642077 / 37542885 / +0.3%	97560970 / 95999399 / +1.6%	0.39 / 0.39 / -1.3%
tpcds_q69/datafusion:parquet	58531922 / 58286484 / +0.4%	105559786 / 104636873 / +0.9%	0.55 / 0.56 / -0.5%
tpcds_q70/datafusion:parquet	47031895 / 47555111 / -1.1%	95386498 / 90912965 / +4.9%	0.49 / 0.52 / -5.7%
tpcds_q71/datafusion:parquet	33345426 / 32585367 / +2.3%	82269693 / 84199892 / -2.3%	0.41 / 0.39 / +4.7%
tpcds_q72/datafusion:parquet	396466466 / 390673182 / +1.5%	511167694 / 495494207 / +3.2%	0.78 / 0.79 / -1.6%
tpcds_q73/datafusion:parquet	30476432 / 30156715 / +1.1%	69891616 / 72647781 / -3.8%	0.44 / 0.42 / +5.0%
tpcds_q74/datafusion:parquet	89667196 / 91977198 / -2.5%	150986303 / 143209641 / +5.4%	0.59 / 0.64 / -7.5%
tpcds_q75/datafusion:parquet	147551140 / 146558028 / +0.7%	238079238 / 234419524 / +1.6%	0.62 / 0.63 / -0.9%
tpcds_q76/datafusion:parquet	48608392 / 47230188 / +2.9%	109171566 / 107744044 / +1.3%	0.45 / 0.44 / +1.6%
tpcds_q77/datafusion:parquet	58634644 / 58952510 / -0.5%	114948704 / 113546171 / +1.2%	0.51 / 0.52 / -1.8%
tpcds_q78/datafusion:parquet	115754972 / 119956566 / -3.5%	208271141 / 207313116 / +0.5%	0.56 / 0.58 / -3.9%
tpcds_q79/datafusion:parquet	34174454 / 34546704 / -1.1%	85089256 / 85337249 / -0.3%	0.40 / 0.40 / -0.8%
tpcds_q80/datafusion:parquet	97617212 / 97588582 / +0.0%	193264019 / 195261141 / -1.0%	0.51 / 0.50 / +1.1%
tpcds_q81/datafusion:parquet	50190646 / 50184449 / +0.0%	98488758 / 99233195 / -0.8%	0.51 / 0.51 / +0.8%
tpcds_q82/datafusion:parquet	26571416 / 27430846 / -3.1%	74944410 / 73770831 / +1.6%	0.35 / 0.37 / -4.6%
tpcds_q83/datafusion:parquet	62717326 / 61867949 / +1.4%	110193394 / 109908546 / +0.3%	0.57 / 0.56 / +1.1%
tpcds_q84/datafusion:parquet	33873366 / 33498870 / +1.1%	71927841 / 75384892 / -4.6%	0.47 / 0.44 / +6.0%
tpcds_q85/datafusion:parquet	89945072 / 89284626 / +0.7%	159106852 / 160211630 / -0.7%	0.57 / 0.56 / +1.4%
tpcds_q86/datafusion:parquet	24041656 / 23341886 / +3.0%	61618093 / 63996887 / -3.7%	0.39 / 0.36 / +7.0%
tpcds_q87/datafusion:parquet	52085356 / 51808732 / +0.5%	109442298 / 98771937 / +10.8% 🔴	0.48 / 0.52 / -9.3%
tpcds_q88/datafusion:parquet	57721200 / 56974647 / +1.3%	118372377 / 119741650 / -1.1%	0.49 / 0.48 / +2.5%
tpcds_q89/datafusion:parquet	30834560 / 29753098 / +3.6%	80118981 / 84618055 / -5.3%	0.38 / 0.35 / +9.5%
tpcds_q90/datafusion:parquet	20819828 / 21039512 / -1.0%	58339430 / 56529617 / +3.2%	0.36 / 0.37 / -4.1%
tpcds_q91/datafusion:parquet	46308720 / 45126878 / +2.6%	90234021 / 83927486 / +7.5%	0.51 / 0.54 / -4.6%
tpcds_q92/datafusion:parquet	26610731 / 26945754 / -1.2%	68468126 / 71529362 / -4.3%	0.39 / 0.38 / +3.2%
tpcds_q93/datafusion:parquet	33644149 / 33754554 / -0.3%	91284523 / 92625022 / -1.4%	0.37 / 0.36 / +1.1%
tpcds_q94/datafusion:parquet	34491048 / 35373706 / -2.5%	78968036 / 76313058 / +3.5%	0.44 / 0.46 / -5.8%
tpcds_q95/datafusion:parquet	59911836 / 61449167 / -2.5%	112809587 / 113986403 / -1.0%	0.53 / 0.54 / -1.5%
tpcds_q96/datafusion:parquet	18212715 / 18780116 / -3.0%	55740059 / 52947528 / +5.3%	0.33 / 0.35 / -7.9%
tpcds_q97/datafusion:parquet	41252458 / 39499108 / +4.4%	90132649 / 94164450 / -4.3%	0.46 / 0.42 / +9.1%
tpcds_q98/datafusion:parquet	31555761 / 31422560 / +0.4%	79303510 / 81446854 / -2.6%	0.40 / 0.39 / +3.1%
tpcds_q99/datafusion:parquet	34587452 / 34694282 / -0.3%	79514084 / 85517661 / -7.0%	0.43 / 0.41 / +7.2%

duckdb / vortex-file-compressed / ns (0.997x ➖, 5↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed	22874998 / 24330915 / -6.0%	44082008 / 42253007 / +4.3%	0.52 / 0.58 / -9.9%
tpcds_q02/duckdb:vortex-file-compressed	28257686 / 29637599 / -4.7%	39596547 / 42994029 / -7.9%	0.71 / 0.69 / +3.5%
tpcds_q03/duckdb:vortex-file-compressed	19243340 / 18086554 / +6.4%	41440594 / 40372360 / +2.6%	0.46 / 0.45 / +3.7%
tpcds_q04/duckdb:vortex-file-compressed	93423734 / 93728752 / -0.3%	120806771 / 124506289 / -3.0%	0.77 / 0.75 / +2.7%
tpcds_q05/duckdb:vortex-file-compressed	32842035 / 32209015 / +2.0%	59009911 / 58287098 / +1.2%	0.56 / 0.55 / +0.7%
tpcds_q06/duckdb:vortex-file-compressed	43804152 / 44743474 / -2.1%	70482961 / 72125396 / -2.3%	0.62 / 0.62 / +0.2%
tpcds_q07/duckdb:vortex-file-compressed	28174586 / 29209110 / -3.5%	66323739 / 61889339 / +7.2%	0.42 / 0.47 / -10.0%
tpcds_q08/duckdb:vortex-file-compressed	35551369 / 35377364 / +0.5%	58692335 / 63276125 / -7.2%	0.61 / 0.56 / +8.3%
tpcds_q09/duckdb:vortex-file-compressed	16983925 / 16700278 / +1.7%	58350785 / 51806478 / +12.6% 🔴	0.29 / 0.32 / -9.7%
tpcds_q10/duckdb:vortex-file-compressed	53106828 / 53315093 / -0.4%	85077165 / 79232781 / +7.4%	0.62 / 0.67 / -7.2%
tpcds_q11/duckdb:vortex-file-compressed	76473359 / 74599556 / +2.5%	98943650 / 103911685 / -4.8%	0.77 / 0.72 / +7.7%
tpcds_q12/duckdb:vortex-file-compressed	18577250 / 17559107 / +5.8%	34068039 / 35210720 / -3.2%	0.55 / 0.50 / +9.3%
tpcds_q13/duckdb:vortex-file-compressed	38203588 / 37250564 / +2.6%	72588787 / 71758604 / +1.2%	0.53 / 0.52 / +1.4%
tpcds_q14/duckdb:vortex-file-compressed	104337406 / 105964276 / -1.5%	148497037 / 143400909 / +3.6%	0.70 / 0.74 / -4.9%
tpcds_q15/duckdb:vortex-file-compressed	33854058 / 33150589 / +2.1%	47745488 / 46743285 / +2.1%	0.71 / 0.71 / -0.0%
tpcds_q16/duckdb:vortex-file-compressed	32054572 / 31603942 / +1.4%	49072683 / 50965345 / -3.7%	0.65 / 0.62 / +5.3%
tpcds_q17/duckdb:vortex-file-compressed	50333863 / 50074339 / +0.5%	83567670 / 90069703 / -7.2%	0.60 / 0.56 / +8.3%
tpcds_q18/duckdb:vortex-file-compressed	46952358 / 47779843 / -1.7%	65921232 / 70271885 / -6.2%	0.71 / 0.68 / +4.8%
tpcds_q19/duckdb:vortex-file-compressed	38419380 / 39729748 / -3.3%	65120791 / 67587305 / -3.6%	0.59 / 0.59 / +0.4%
tpcds_q20/duckdb:vortex-file-compressed	16864634 / 18923810 / -10.9% 🟢	34726082 / 34286180 / +1.3%	0.49 / 0.55 / -12.0%
tpcds_q21/duckdb:vortex-file-compressed	19976120 / 25074712 / -20.3% 🟢	52677338 / 51013469 / +3.3%	0.38 / 0.49 / -22.8%
tpcds_q22/duckdb:vortex-file-compressed	62867813 / 66536368 / -5.5%	109905418 / 105652354 / +4.0%	0.57 / 0.63 / -9.2%
tpcds_q23/duckdb:vortex-file-compressed	70353018 / 68627394 / +2.5%	112330616 / 114682738 / -2.1%	0.63 / 0.60 / +4.7%
tpcds_q24/duckdb:vortex-file-compressed	51025720 / 50429722 / +1.2%	81045178 / 81568307 / -0.6%	0.63 / 0.62 / +1.8%
tpcds_q25/duckdb:vortex-file-compressed	42373104 / 42772701 / -0.9%	70840959 / 70264828 / +0.8%	0.60 / 0.61 / -1.7%
tpcds_q26/duckdb:vortex-file-compressed	22803924 / 25098632 / -9.1%	41952721 / 40891947 / +2.6%	0.54 / 0.61 / -11.4%
tpcds_q27/duckdb:vortex-file-compressed	30022969 / 32221626 / -6.8%	61711820 / 56585309 / +9.1%	0.49 / 0.57 / -14.6%
tpcds_q28/duckdb:vortex-file-compressed	12536198 / 12722853 / -1.5%	28668963 / 25037984 / +14.5% 🔴	0.44 / 0.51 / -13.9%
tpcds_q29/duckdb:vortex-file-compressed	51054482 / 50072724 / +2.0%	85561932 / 89692590 / -4.6%	0.60 / 0.56 / +6.9%
tpcds_q30/duckdb:vortex-file-compressed	33499003 / 35786801 / -6.4%	56365940 / 55052560 / +2.4%	0.59 / 0.65 / -8.6%
tpcds_q31/duckdb:vortex-file-compressed	32408616 / 32936252 / -1.6%	59595878 / 57336008 / +3.9%	0.54 / 0.57 / -5.3%
tpcds_q32/duckdb:vortex-file-compressed	17834385 / 20354004 / -12.4% 🟢	38462299 / 40644150 / -5.4%	0.46 / 0.50 / -7.4%
tpcds_q33/duckdb:vortex-file-compressed	29244218 / 30733418 / -4.8%	60088610 / 65350864 / -8.1%	0.49 / 0.47 / +3.5%
tpcds_q34/duckdb:vortex-file-compressed	23871978 / 25444276 / -6.2%	45795268 / 45543908 / +0.6%	0.52 / 0.56 / -6.7%
tpcds_q35/duckdb:vortex-file-compressed	77587006 / 78175975 / -0.8%	109434045 / 112111397 / -2.4%	0.71 / 0.70 / +1.7%
tpcds_q36/duckdb:vortex-file-compressed	26270194 / 27165126 / -3.3%	58536828 / 59660202 / -1.9%	0.45 / 0.46 / -1.4%
tpcds_q37/duckdb:vortex-file-compressed	25758578 / 22973472 / +12.1% 🔴	50710850 / 54014844 / -6.1%	0.51 / 0.43 / +19.4%
tpcds_q38/duckdb:vortex-file-compressed	37923161 / 38441414 / -1.3%	63657836 / 60161792 / +5.8%	0.60 / 0.64 / -6.8%
tpcds_q39/duckdb:vortex-file-compressed	36387442 / 34476634 / +5.5%	65769441 / 68277223 / -3.7%	0.55 / 0.50 / +9.6%
tpcds_q40/duckdb:vortex-file-compressed	23831830 / 22296824 / +6.9%	40332173 / 38489125 / +4.8%	0.59 / 0.58 / +2.0%
tpcds_q41/duckdb:vortex-file-compressed	9893265 / 9393184 / +5.3%	19148871 / 19467179 / -1.6%	0.52 / 0.48 / +7.1%
tpcds_q42/duckdb:vortex-file-compressed	15995708 / 15865434 / +0.8%	38082310 / 39931096 / -4.6%	0.42 / 0.40 / +5.7%
tpcds_q43/duckdb:vortex-file-compressed	19907662 / 19120122 / +4.1%	39959917 / 40614885 / -1.6%	0.50 / 0.47 / +5.8%
tpcds_q44/duckdb:vortex-file-compressed	23961110 / 23582328 / +1.6%	65275359 / 63149391 / +3.4%	0.37 / 0.37 / -1.7%
tpcds_q45/duckdb:vortex-file-compressed	36319155 / 33954555 / +7.0%	51268293 / 51318798 / -0.1%	0.71 / 0.66 / +7.1%
tpcds_q46/duckdb:vortex-file-compressed	33671246 / 32205442 / +4.6%	60964669 / 61824934 / -1.4%	0.55 / 0.52 / +6.0%
tpcds_q47/duckdb:vortex-file-compressed	54293436 / 55852214 / -2.8%	86141368 / 86401325 / -0.3%	0.63 / 0.65 / -2.5%
tpcds_q48/duckdb:vortex-file-compressed	35490026 / 35235581 / +0.7%	65946029 / 74609143 / -11.6% 🟢	0.54 / 0.47 / +14.0%
tpcds_q49/duckdb:vortex-file-compressed	32032038 / 34111923 / -6.1%	69184072 / 70859842 / -2.4%	0.46 / 0.48 / -3.8%
tpcds_q50/duckdb:vortex-file-compressed	29168740 / 29896477 / -2.4%	58304987 / 60825618 / -4.1%	0.50 / 0.49 / +1.8%
tpcds_q51/duckdb:vortex-file-compressed	115185068 / 99541262 / +15.7% 🔴	122585302 / 123238059 / -0.5%	0.94 / 0.81 / +16.3%
tpcds_q52/duckdb:vortex-file-compressed	17966610 / 17577568 / +2.2%	39451222 / 42099101 / -6.3%	0.46 / 0.42 / +9.1%
tpcds_q53/duckdb:vortex-file-compressed	25048506 / 24226784 / +3.4%	48595419 / 48148511 / +0.9%	0.52 / 0.50 / +2.4%
tpcds_q54/duckdb:vortex-file-compressed	34764928 / 36996424 / -6.0%	74898909 / 69178049 / +8.3%	0.46 / 0.53 / -13.2%
tpcds_q55/duckdb:vortex-file-compressed	17085394 / 16512140 / +3.5%	39393569 / 40516041 / -2.8%	0.43 / 0.41 / +6.4%
tpcds_q56/duckdb:vortex-file-compressed	31510533 / 29562691 / +6.6%	62026919 / 59625559 / +4.0%	0.51 / 0.50 / +2.5%
tpcds_q57/duckdb:vortex-file-compressed	39360950 / 41051385 / -4.1%	57768133 / 61960775 / -6.8%	0.68 / 0.66 / +2.8%
tpcds_q58/duckdb:vortex-file-compressed	30661120 / 33038180 / -7.2%	54816709 / 58048626 / -5.6%	0.56 / 0.57 / -1.7%
tpcds_q59/duckdb:vortex-file-compressed	37485316 / 38393361 / -2.4%	57058290 / 58062014 / -1.7%	0.66 / 0.66 / -0.6%
tpcds_q60/duckdb:vortex-file-compressed	29682250 / 29494230 / +0.6%	61628473 / 59794094 / +3.1%	0.48 / 0.49 / -2.4%
tpcds_q61/duckdb:vortex-file-compressed	34849080 / 37187124 / -6.3%	78845121 / 75402897 / +4.6%	0.44 / 0.49 / -10.4%
tpcds_q62/duckdb:vortex-file-compressed	16750762 / 19191408 / -12.7% 🟢	34630062 / 34711134 / -0.2%	0.48 / 0.55 / -12.5%
tpcds_q63/duckdb:vortex-file-compressed	22926209 / 21535532 / +6.5%	47197526 / 46288668 / +2.0%	0.49 / 0.47 / +4.4%
tpcds_q64/duckdb:vortex-file-compressed	106368847 / 108077109 / -1.6%	140200897 / 146564341 / -4.3%	0.76 / 0.74 / +2.9%
tpcds_q65/duckdb:vortex-file-compressed	24052732 / 23790936 / +1.1%	47018256 / 49389899 / -4.8%	0.51 / 0.48 / +6.2%
tpcds_q66/duckdb:vortex-file-compressed	38858246 / 37658594 / +3.2%	69291862 / 66419776 / +4.3%	0.56 / 0.57 / -1.1%
tpcds_q67/duckdb:vortex-file-compressed	127067070 / 125247894 / +1.5%	153740631 / 157009846 / -2.1%	0.83 / 0.80 / +3.6%
tpcds_q68/duckdb:vortex-file-compressed	30836922 / 30902836 / -0.2%	67675251 / 66399735 / +1.9%	0.46 / 0.47 / -2.1%
tpcds_q69/duckdb:vortex-file-compressed	53446654 / 54214780 / -1.4%	84821365 / 88905520 / -4.6%	0.63 / 0.61 / +3.3%
tpcds_q70/duckdb:vortex-file-compressed	34006874 / 36183496 / -6.0%	61214856 / 64233760 / -4.7%	0.56 / 0.56 / -1.4%
tpcds_q71/duckdb:vortex-file-compressed	24842244 / 24899131 / -0.2%	56109456 / 50468274 / +11.2% 🔴	0.44 / 0.49 / -10.3%
tpcds_q72/duckdb:vortex-file-compressed	140937355 / 144863353 / -2.7%	190201114 / 190163958 / +0.0%	0.74 / 0.76 / -2.7%
tpcds_q73/duckdb:vortex-file-compressed	25233440 / 23078219 / +9.3%	44131717 / 45918055 / -3.9%	0.57 / 0.50 / +13.8%
tpcds_q74/duckdb:vortex-file-compressed	50561976 / 48897164 / +3.4%	74480415 / 80139790 / -7.1%	0.68 / 0.61 / +11.3%
tpcds_q75/duckdb:vortex-file-compressed	51407742 / 55934188 / -8.1%	87847515 / 82183814 / +6.9%	0.59 / 0.68 / -14.0%
tpcds_q76/duckdb:vortex-file-compressed	22426417 / 23527582 / -4.7%	56165788 / 60261774 / -6.8%	0.40 / 0.39 / +2.3%
tpcds_q77/duckdb:vortex-file-compressed	28667535 / 29107063 / -1.5%	55064028 / 54255534 / +1.5%	0.52 / 0.54 / -3.0%
tpcds_q78/duckdb:vortex-file-compressed	72497734 / 72523402 / -0.0%	97101850 / 97117989 / -0.0%	0.75 / 0.75 / -0.0%
tpcds_q79/duckdb:vortex-file-compressed	26792550 / 26153288 / +2.4%	56743961 / 58794264 / -3.5%	0.47 / 0.44 / +6.1%
tpcds_q80/duckdb:vortex-file-compressed	50856726 / 51522157 / -1.3%	84329799 / 90967356 / -7.3%	0.60 / 0.57 / +6.5%
tpcds_q81/duckdb:vortex-file-compressed	40262338 / 39487276 / +2.0%	55701585 / 58552183 / -4.9%	0.72 / 0.67 / +7.2%
tpcds_q82/duckdb:vortex-file-compressed	53090678 / 55854142 / -4.9%	76240730 / 79094722 / -3.6%	0.70 / 0.71 / -1.4%
tpcds_q83/duckdb:vortex-file-compressed	30260346 / 30959803 / -2.3%	47031750 / 44231816 / +6.3%	0.64 / 0.70 / -8.1%
tpcds_q84/duckdb:vortex-file-compressed	24692854 / 22947082 / +7.6%	37472548 / 40654247 / -7.8%	0.66 / 0.56 / +16.7%
tpcds_q85/duckdb:vortex-file-compressed	50639387 / 49011308 / +3.3%	74786018 / 73737170 / +1.4%	0.68 / 0.66 / +1.9%
tpcds_q86/duckdb:vortex-file-compressed	19257060 / 18763278 / +2.6%	40431536 / 37614613 / +7.5%	0.48 / 0.50 / -4.5%
tpcds_q87/duckdb:vortex-file-compressed	42555330 / 42187246 / +0.9%	64215767 / 67220432 / -4.5%	0.66 / 0.63 / +5.6%
tpcds_q88/duckdb:vortex-file-compressed	61125544 / 59397581 / +2.9%	112571092 / 111619107 / +0.9%	0.54 / 0.53 / +2.0%
tpcds_q89/duckdb:vortex-file-compressed	25115035 / 23433140 / +7.2%	49469781 / 50084848 / -1.2%	0.51 / 0.47 / +8.5%
tpcds_q90/duckdb:vortex-file-compressed	15369066 / 14086748 / +9.1%	32428224 / 30311457 / +7.0%	0.47 / 0.46 / +2.0%
tpcds_q91/duckdb:vortex-file-compressed	27941682 / 28176996 / -0.8%	42850382 / 42945154 / -0.2%	0.65 / 0.66 / -0.6%
tpcds_q92/duckdb:vortex-file-compressed	21558454 / 20523480 / +5.0%	38398261 / 38964601 / -1.5%	0.56 / 0.53 / +6.6%
tpcds_q93/duckdb:vortex-file-compressed	32433240 / 28414238 / +14.1% 🔴	48324914 / 47884179 / +0.9%	0.67 / 0.59 / +13.1%
tpcds_q94/duckdb:vortex-file-compressed	27919024 / 27751878 / +0.6%	49850737 / 50806872 / -1.9%	0.56 / 0.55 / +2.5%
tpcds_q95/duckdb:vortex-file-compressed	138437228 / 139266574 / -0.6%	160015017 / 158517076 / +0.9%	0.87 / 0.88 / -1.5%
tpcds_q96/duckdb:vortex-file-compressed	17450596 / 15159230 / +15.1% 🔴	31836250 / 35750165 / -10.9% 🟢	0.55 / 0.42 / +29.3%
tpcds_q97/duckdb:vortex-file-compressed	39558428 / 39455688 / +0.3%	65206091 / 65738286 / -0.8%	0.61 / 0.60 / +1.1%
tpcds_q98/duckdb:vortex-file-compressed	21495125 / 23569094 / -8.8%	47563601 / 46975585 / +1.3%	0.45 / 0.50 / -9.9%
tpcds_q99/duckdb:vortex-file-compressed	23616216 / 27468766 / -14.0% 🟢	39074378 / 41124251 / -5.0%	0.60 / 0.67 / -9.5%

duckdb / parquet / ns (1.001x ➖, 2↑ 2↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet	33181746 / 30963876 / +7.2%	48068902 / 46982717 / +2.3%	0.69 / 0.66 / +4.7%
tpcds_q02/duckdb:parquet	24428222 / 26106916 / -6.4%	33000277 / 36087118 / -8.6%	0.74 / 0.72 / +2.3%
tpcds_q03/duckdb:parquet	14045246 / 12261897 / +14.5% 🔴	26082691 / 24516638 / +6.4%	0.54 / 0.50 / +7.7%
tpcds_q04/duckdb:parquet	190740008 / 193327950 / -1.3%	203962725 / 204979589 / -0.5%	0.94 / 0.94 / -0.8%
tpcds_q05/duckdb:parquet	32710284 / 33328270 / -1.9%	41042847 / 41245430 / -0.5%	0.80 / 0.81 / -1.4%
tpcds_q06/duckdb:parquet	35290360 / 35037728 / +0.7%	55334441 / 55617371 / -0.5%	0.64 / 0.63 / +1.2%
tpcds_q07/duckdb:parquet	22654142 / 22068188 / +2.7%	36429932 / 35023570 / +4.0%	0.62 / 0.63 / -1.3%
tpcds_q08/duckdb:parquet	32880608 / 33222120 / -1.0%	46822242 / 46849595 / -0.1%	0.70 / 0.71 / -1.0%
tpcds_q09/duckdb:parquet	31058056 / 30597072 / +1.5%	37662168 / 38300099 / -1.7%	0.82 / 0.80 / +3.2%
tpcds_q10/duckdb:parquet	42835138 / 41460754 / +3.3%	57738930 / 59861697 / -3.5%	0.74 / 0.69 / +7.1%
tpcds_q11/duckdb:parquet	103983939 / 106158378 / -2.0%	125370045 / 122368739 / +2.5%	0.83 / 0.87 / -4.4%
tpcds_q12/duckdb:parquet	17291870 / 18072368 / -4.3%	27625883 / 27184275 / +1.6%	0.63 / 0.66 / -5.8%
tpcds_q13/duckdb:parquet	34684171 / 34519682 / +0.5%	50167102 / 50783682 / -1.2%	0.69 / 0.68 / +1.7%
tpcds_q14/duckdb:parquet	105225532 / 102827983 / +2.3%	116827217 / 113995245 / +2.5%	0.90 / 0.90 / -0.1%
tpcds_q15/duckdb:parquet	35486506 / 35938538 / -1.3%	47200039 / 47878422 / -1.4%	0.75 / 0.75 / +0.2%
tpcds_q16/duckdb:parquet	28047830 / 27260722 / +2.9%	43528394 / 41769780 / +4.2%	0.64 / 0.65 / -1.3%
tpcds_q17/duckdb:parquet	45180560 / 44996366 / +0.4%	58470016 / 58640988 / -0.3%	0.77 / 0.77 / +0.7%
tpcds_q18/duckdb:parquet	55093966 / 56155358 / -1.9%	74957300 / 78319158 / -4.3%	0.74 / 0.72 / +2.5%
tpcds_q19/duckdb:parquet	33755304 / 33283749 / +1.4%	46366247 / 45794994 / +1.2%	0.73 / 0.73 / +0.2%
tpcds_q20/duckdb:parquet	19464852 / 19979834 / -2.6%	29784182 / 29090936 / +2.4%	0.65 / 0.69 / -4.8%
tpcds_q21/duckdb:parquet	14724316 / 14066078 / +4.7%	27635592 / 32744127 / -15.6% 🟢	0.53 / 0.43 / +24.0%
tpcds_q22/duckdb:parquet	70381152 / 66364119 / +6.1%	78770319 / 76686396 / +2.7%	0.89 / 0.87 / +3.2%
tpcds_q23/duckdb:parquet	64480208 / 64681968 / -0.3%	82898751 / 81763919 / +1.4%	0.78 / 0.79 / -1.7%
tpcds_q24/duckdb:parquet	48411604 / 48531710 / -0.2%	69082193 / 72131919 / -4.2%	0.70 / 0.67 / +4.2%
tpcds_q25/duckdb:parquet	41412516 / 41990975 / -1.4%	58826022 / 57512285 / +2.3%	0.70 / 0.73 / -3.6%
tpcds_q26/duckdb:parquet	43721524 / 45118188 / -3.1%	58536441 / 59166294 / -1.1%	0.75 / 0.76 / -2.1%
tpcds_q27/duckdb:parquet	54490784 / 54590954 / -0.2%	70336596 / 72945626 / -3.6%	0.77 / 0.75 / +3.5%
tpcds_q28/duckdb:parquet	29129428 / 29709032 / -2.0%	37495005 / 50848339 / -26.3% 🟢	0.78 / 0.58 / +33.0%
tpcds_q29/duckdb:parquet	42663467 / 43569092 / -2.1%	60655078 / 57373095 / +5.7%	0.70 / 0.76 / -7.4%
tpcds_q30/duckdb:parquet	44793773 / 43900680 / +2.0%	59202398 / 59055463 / +0.2%	0.76 / 0.74 / +1.8%
tpcds_q31/duckdb:parquet	29882331 / 28671254 / +4.2%	41680955 / 41583307 / +0.2%	0.72 / 0.69 / +4.0%
tpcds_q32/duckdb:parquet	14892397 / 15618124 / -4.6%	26097913 / 28123061 / -7.2%	0.57 / 0.56 / +2.8%
tpcds_q33/duckdb:parquet	24234937 / 23537166 / +3.0%	38350560 / 39856201 / -3.8%	0.63 / 0.59 / +7.0%
tpcds_q34/duckdb:parquet	21884796 / 21974464 / -0.4%	35048050 / 34403140 / +1.9%	0.62 / 0.64 / -2.2%
tpcds_q35/duckdb:parquet	66986356 / 69077787 / -3.0%	85696536 / 88019925 / -2.6%	0.78 / 0.78 / -0.4%
tpcds_q36/duckdb:parquet	22711137 / 26013000 / -12.7% 🟢	38585086 / 38803438 / -0.6%	0.59 / 0.67 / -12.2%
tpcds_q37/duckdb:parquet	19025910 / 18148740 / +4.8%	31365543 / 29054109 / +8.0%	0.61 / 0.62 / -2.9%
tpcds_q38/duckdb:parquet	41251655 / 40727430 / +1.3%	50120157 / 50222445 / -0.2%	0.82 / 0.81 / +1.5%
tpcds_q39/duckdb:parquet	37079968 / 36904363 / +0.5%	48729925 / 49760819 / -2.1%	0.76 / 0.74 / +2.6%
tpcds_q40/duckdb:parquet	22878178 / 22916224 / -0.2%	32430048 / 36029182 / -10.0%	0.71 / 0.64 / +10.9%
tpcds_q41/duckdb:parquet	10349600 / 10633024 / -2.7%	21881286 / 23939811 / -8.6%	0.47 / 0.44 / +6.5%
tpcds_q42/duckdb:parquet	11588250 / 13271107 / -12.7% 🟢	21984993 / 22701392 / -3.2%	0.53 / 0.58 / -9.8%
tpcds_q43/duckdb:parquet	14918195 / 15029624 / -0.7%	25974400 / 26211493 / -0.9%	0.57 / 0.57 / +0.2%
tpcds_q44/duckdb:parquet	25061272 / 25157548 / -0.4%	36712002 / 39616894 / -7.3%	0.68 / 0.64 / +7.5%
tpcds_q45/duckdb:parquet	31741826 / 32153274 / -1.3%	43035220 / 43938282 / -2.1%	0.74 / 0.73 / +0.8%
tpcds_q46/duckdb:parquet	50260510 / 49927908 / +0.7%	66423977 / 67942514 / -2.2%	0.76 / 0.73 / +3.0%
tpcds_q47/duckdb:parquet	47902236 / 50626998 / -5.4%	60852104 / 63228723 / -3.8%	0.79 / 0.80 / -1.7%
tpcds_q48/duckdb:parquet	30672357 / 30472032 / +0.7%	44301980 / 44148800 / +0.3%	0.69 / 0.69 / +0.3%
tpcds_q49/duckdb:parquet	28914757 / 28982914 / -0.2%	43472126 / 44675946 / -2.7%	0.67 / 0.65 / +2.5%
tpcds_q50/duckdb:parquet	24969281 / 24820174 / +0.6%	38242924 / 37814042 / +1.1%	0.65 / 0.66 / -0.5%
tpcds_q51/duckdb:parquet	94870502 / 99604083 / -4.8%	113250051 / 138687288 / -18.3% 🟢	0.84 / 0.72 / +16.6%
tpcds_q52/duckdb:parquet	12889712 / 11981952 / +7.6%	23931247 / 22553121 / +6.1%	0.54 / 0.53 / +1.4%
tpcds_q53/duckdb:parquet	16365417 / 17965460 / -8.9%	28659151 / 30703317 / -6.7%	0.57 / 0.59 / -2.4%
tpcds_q54/duckdb:parquet	30478970 / 30275316 / +0.7%	45099061 / 45393794 / -0.6%	0.68 / 0.67 / +1.3%
tpcds_q55/duckdb:parquet	12196154 / 12305860 / -0.9%	22931797 / 23272255 / -1.5%	0.53 / 0.53 / +0.6%
tpcds_q56/duckdb:parquet	24772003 / 25684782 / -3.6%	40174170 / 39140803 / +2.6%	0.62 / 0.66 / -6.0%
tpcds_q57/duckdb:parquet	43276766 / 42614812 / +1.6%	55770683 / 53595703 / +4.1%	0.78 / 0.80 / -2.4%
tpcds_q58/duckdb:parquet	29523611 / 27281620 / +8.2%	40592548 / 39339005 / +3.2%	0.73 / 0.69 / +4.9%
tpcds_q59/duckdb:parquet	42384982 / 30338530 / +39.7% 🔴	52564165 / 44190291 / +18.9% 🔴	0.81 / 0.69 / +17.5%
tpcds_q60/duckdb:parquet	27323382 / 26808186 / +1.9%	40260286 / 41277351 / -2.5%	0.68 / 0.65 / +4.5%
tpcds_q61/duckdb:parquet	31731700 / 31875044 / -0.4%	43348211 / 45238143 / -4.2%	0.73 / 0.70 / +3.9%
tpcds_q62/duckdb:parquet	14671639 / 14726680 / -0.4%	22775475 / 23206249 / -1.9%	0.64 / 0.63 / +1.5%
tpcds_q63/duckdb:parquet	15750314 / 15541178 / +1.3%	29626994 / 29060223 / +2.0%	0.53 / 0.53 / -0.6%
tpcds_q64/duckdb:parquet	79952963 / 77659388 / +3.0%	98784820 / 105513694 / -6.4%	0.81 / 0.74 / +10.0%
tpcds_q65/duckdb:parquet	21666780 / 21340612 / +1.5%	39106538 / 37316672 / +4.8%	0.55 / 0.57 / -3.1%
tpcds_q66/duckdb:parquet	35897428 / 34982014 / +2.6%	47779917 / 47627750 / +0.3%	0.75 / 0.73 / +2.3%
tpcds_q67/duckdb:parquet	124791886 / 122565673 / +1.8%	131796665 / 151648299 / -13.1% 🟢	0.95 / 0.81 / +17.2%
tpcds_q68/duckdb:parquet	39032718 / 42406061 / -8.0%	59645272 / 62604270 / -4.7%	0.65 / 0.68 / -3.4%
tpcds_q69/duckdb:parquet	42798486 / 41913396 / +2.1%	58342128 / 59989020 / -2.7%	0.73 / 0.70 / +5.0%
tpcds_q70/duckdb:parquet	28040454 / 28344570 / -1.1%	44888959 / 47987750 / -6.5%	0.62 / 0.59 / +5.8%
tpcds_q71/duckdb:parquet	21425922 / 21905936 / -2.2%	34163346 / 36145834 / -5.5%	0.63 / 0.61 / +3.5%
tpcds_q72/duckdb:parquet	191342028 / 184062348 / +4.0%	132053984 / 137580470 / -4.0%	1.45 / 1.34 / +8.3%
tpcds_q73/duckdb:parquet	19192552 / 18434921 / +4.1%	29429408 / 34460657 / -14.6% 🟢	0.65 / 0.53 / +21.9%
tpcds_q74/duckdb:parquet	146130671 / 145503625 / +0.4%	161088895 / 155281768 / +3.7%	0.91 / 0.94 / -3.2%
tpcds_q75/duckdb:parquet	59749228 / 59378297 / +0.6%	81849470 / 80794672 / +1.3%	0.73 / 0.73 / -0.7%
tpcds_q76/duckdb:parquet	19752110 / 20043758 / -1.5%	32324779 / 32148477 / +0.5%	0.61 / 0.62 / -2.0%
tpcds_q77/duckdb:parquet	25050676 / 25768701 / -2.8%	39541604 / 42222509 / -6.3%	0.63 / 0.61 / +3.8%
tpcds_q78/duckdb:parquet	79088119 / 77863010 / +1.6%	90522252 / 91735305 / -1.3%	0.87 / 0.85 / +2.9%
tpcds_q79/duckdb:parquet	28298990 / 27783156 / +1.9%	44156555 / 43939664 / +0.5%	0.64 / 0.63 / +1.4%
tpcds_q80/duckdb:parquet	47807142 / 47381357 / +0.9%	60935509 / 60448215 / +0.8%	0.78 / 0.78 / +0.1%
tpcds_q81/duckdb:parquet	40398032 / 40361804 / +0.1%	58027498 / 59852673 / -3.0%	0.70 / 0.67 / +3.2%
tpcds_q82/duckdb:parquet	18997548 / 19802138 / -4.1%	34928097 / 33470507 / +4.4%	0.54 / 0.59 / -8.1%
tpcds_q83/duckdb:parquet	22026762 / 23158204 / -4.9%	32126968 / 33894153 / -5.2%	0.69 / 0.68 / +0.3%
tpcds_q84/duckdb:parquet	23842916 / 23484160 / +1.5%	33633460 / 34927487 / -3.7%	0.71 / 0.67 / +5.4%
tpcds_q85/duckdb:parquet	47989905 / 48383417 / -0.8%	63352754 / 66774266 / -5.1%	0.76 / 0.72 / +4.5%
tpcds_q86/duckdb:parquet	15162126 / 15228052 / -0.4%	25567937 / 26208308 / -2.4%	0.59 / 0.58 / +2.1%
tpcds_q87/duckdb:parquet	44345095 / 43359282 / +2.3%	56513809 / 54128363 / +4.4%	0.78 / 0.80 / -2.0%
tpcds_q88/duckdb:parquet	42614275 / 42601368 / +0.0%	49895294 / 55561340 / -10.2% 🟢	0.85 / 0.77 / +11.4%
tpcds_q89/duckdb:parquet	18367952 / 18024694 / +1.9%	32787085 / 33965119 / -3.5%	0.56 / 0.53 / +5.6%
tpcds_q90/duckdb:parquet	9902238 / 10965981 / -9.7%	19572096 / 21500811 / -9.0%	0.51 / 0.51 / -0.8%
tpcds_q91/duckdb:parquet	27444106 / 27878356 / -1.6%	42714559 / 45897330 / -6.9%	0.64 / 0.61 / +5.8%
tpcds_q92/duckdb:parquet	15439279 / 15474854 / -0.2%	27699217 / 27081891 / +2.3%	0.56 / 0.57 / -2.5%
tpcds_q93/duckdb:parquet	33405604 / 33129616 / +0.8%	48214628 / 48666330 / -0.9%	0.69 / 0.68 / +1.8%
tpcds_q94/duckdb:parquet	21833994 / 21570359 / +1.2%	35269925 / 36797400 / -4.2%	0.62 / 0.59 / +5.6%
tpcds_q95/duckdb:parquet	136839054 / 136914265 / -0.1%	151784933 / 143599217 / +5.7%	0.90 / 0.95 / -5.4%
tpcds_q96/duckdb:parquet	10961816 / 11424434 / -4.0%	17990651 / 17900474 / +0.5%	0.61 / 0.64 / -4.5%
tpcds_q97/duckdb:parquet	40171668 / 40131426 / +0.1%	48911886 / 50473070 / -3.1%	0.82 / 0.80 / +3.3%
tpcds_q98/duckdb:parquet	22634555 / 21129123 / +7.1%	34339041 / 34467285 / -0.4%	0.66 / 0.61 / +7.5%
tpcds_q99/duckdb:parquet	24195272 / 26289066 / -8.0%	32976166 / 33434767 / -1.4%	0.73 / 0.79 / -6.7%

No file size changes detected.

github-actions · 2026-08-27T18:27:04Z

Benchmarks: FineWeb S3 📖

Commits: PR ff4c1879 vs base 01f147a5
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +59.1%
Engines: DataFusion No clear signal (+40.3%, environment too noisy confidence) · DuckDB No clear signal (+80.4%, environment too noisy confidence)
Vortex (geomean): hot 1.150x ➖ · cold 1.040x ➖
Parquet (geomean): hot 0.723x ➖ · cold 1.024x ➖
Shifts: Parquet (control) -27.7% · Median polish -6.6%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.311x ❌, 0↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed	128851120 / 38959206 / +230.7% 🔴	248663366 / 115259213 / +115.7% 🔴	0.52 / 0.34 / +53.3%
fineweb_q01/datafusion:vortex-file-compressed	430341637 / 503228555 / -14.5%	757936536 / 962514691 / -21.3%	0.57 / 0.52 / +8.6%
fineweb_q02/datafusion:vortex-file-compressed	853742182 / 408004854 / +109.2% 🔴	655563654 / 471594646 / +39.0% 🔴	1.30 / 0.87 / +50.5%
fineweb_q03/datafusion:vortex-file-compressed	468986766 / 442922204 / +5.9%	908400955 / 815997416 / +11.3%	0.52 / 0.54 / -4.9%
fineweb_q04/datafusion:vortex-file-compressed	586206046 / 654124772 / -10.4%	456079260 / 529161015 / -13.8%	1.29 / 1.24 / +4.0%
fineweb_q05/datafusion:vortex-file-compressed	583160692 / 555991122 / +4.9%	424034306 / 411655674 / +3.0%	1.38 / 1.35 / +1.8%
fineweb_q06/datafusion:vortex-file-compressed	823292085 / 651405222 / +26.4%	757880072 / 674502045 / +12.4%	1.09 / 0.97 / +12.5%
fineweb_q07/datafusion:vortex-file-compressed	602357600 / 456023250 / +32.1% 🔴	580670536 / 498442717 / +16.5%	1.04 / 0.91 / +13.4%
fineweb_q08/datafusion:vortex-file-compressed	289074358 / 248499128 / +16.3%	258555969 / 291163191 / -11.2%	1.12 / 0.85 / +31.0%

datafusion / parquet / ns (0.935x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet	518642356 / 645819698 / -19.7%	981047713 / 1114399162 / -12.0%	0.53 / 0.58 / -8.8%
fineweb_q01/datafusion:parquet	884747855 / 1209855466 / -26.9%	1127447932 / 1104188363 / +2.1%	0.78 / 1.10 / -28.4%
fineweb_q02/datafusion:parquet	993265890 / 988950102 / +0.4%	1381495428 / 1284289015 / +7.6%	0.72 / 0.77 / -6.6%
fineweb_q03/datafusion:parquet	1074243610 / 970132944 / +10.7%	1006865297 / 1070710142 / -6.0%	1.07 / 0.91 / +17.8%
fineweb_q04/datafusion:parquet	1310882555 / 972663010 / +34.8% 🔴	1387949833 / 1037106230 / +33.8% 🔴	0.94 / 0.94 / +0.7%
fineweb_q05/datafusion:parquet	1192086667 / 1219661546 / -2.3%	1373815696 / 1094627792 / +25.5%	0.87 / 1.11 / -22.1%
fineweb_q06/datafusion:parquet	1075241916 / 1188320395 / -9.5%	1131879665 / 1066659228 / +6.1%	0.95 / 1.11 / -14.7%
fineweb_q07/datafusion:parquet	936883619 / 1083659050 / -13.5%	943008639 / 1285476496 / -26.6%	0.99 / 0.84 / +17.9%
fineweb_q08/datafusion:parquet	925282940 / 1143511930 / -19.1%	1138716590 / 1024649541 / +11.1%	0.81 / 1.12 / -27.2%

duckdb / vortex-file-compressed / ns (1.009x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed	73699168 / 72824416 / +1.2%	90928784 / 81972090 / +10.9%	0.81 / 0.89 / -8.8%
fineweb_q01/duckdb:vortex-file-compressed	529843324 / 538793534 / -1.7%	634011391 / 926086002 / -31.5% 🟢	0.84 / 0.58 / +43.6%
fineweb_q02/duckdb:vortex-file-compressed	725287003 / 669782091 / +8.3%	728994663 / 782260886 / -6.8%	0.99 / 0.86 / +16.2%
fineweb_q03/duckdb:vortex-file-compressed	1559538045 / 1461744338 / +6.7%	1784267956 / 1660423499 / +7.5%	0.87 / 0.88 / -0.7%
fineweb_q04/duckdb:vortex-file-compressed	1638203050 / 1681782124 / -2.6%	1625113001 / 1670682370 / -2.7%	1.01 / 1.01 / +0.1%
fineweb_q05/duckdb:vortex-file-compressed	1559106566 / 1590894498 / -2.0%	1607062752 / 1607001056 / +0.0%	0.97 / 0.99 / -2.0%
fineweb_q06/duckdb:vortex-file-compressed	1660137628 / 1665328015 / -0.3%	1681773995 / 1650327920 / +1.9%	0.99 / 1.01 / -2.2%
fineweb_q07/duckdb:vortex-file-compressed	1491382744 / 1478648786 / +0.9%	1466295925 / 1495369986 / -1.9%	1.02 / 0.99 / +2.9%
fineweb_q08/duckdb:vortex-file-compressed	627303402 / 639308488 / -1.9%	710176983 / 697824551 / +1.8%	0.88 / 0.92 / -3.6%

duckdb / parquet / ns (0.559x ✅, 5↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet	616069833 / 5287587859 / -88.3% 🟢	706887374 / 770351824 / -8.2%	0.87 / 6.86 / -87.3%
fineweb_q01/duckdb:parquet	5279250912 / 5370072022 / -1.7%	733292310 / 886535747 / -17.3%	7.20 / 6.06 / +18.9%
fineweb_q02/duckdb:parquet	626790013 / 5343414600 / -88.3% 🟢	830995484 / 641678657 / +29.5%	0.75 / 8.33 / -90.9%
fineweb_q03/duckdb:parquet	3474531974 / 5383264684 / -35.5% 🟢	1301517816 / 1298265386 / +0.3%	2.67 / 4.15 / -35.6%
fineweb_q04/duckdb:parquet	5265524352 / 3034649068 / +73.5% 🔴	976997173 / 839231003 / +16.4%	5.39 / 3.62 / +49.0%
fineweb_q05/duckdb:parquet	3127344748 / 5313680094 / -41.1% 🟢	882939847 / 848008296 / +4.1%	3.54 / 6.27 / -43.5%
fineweb_q06/duckdb:parquet	5411100631 / 5375966112 / +0.7%	1479281062 / 1376276226 / +7.5%	3.66 / 3.91 / -6.4%
fineweb_q07/duckdb:parquet	3200252937 / 5338411132 / -40.1% 🟢	974645916 / 990219963 / -1.6%	3.28 / 5.39 / -39.1%
fineweb_q08/duckdb:parquet	5258492192 / 5261397302 / -0.1%	557869346 / 605938964 / -7.9%	9.43 / 8.68 / +8.6%

github-actions · 2026-08-27T18:27:27Z

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR ff4c1879 vs base 68d6573b
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -1.1%
Engines: DataFusion No clear signal (+0.3%, low confidence) · DuckDB No clear signal (-2.5%, environment too noisy confidence)
Vortex (geomean): hot 0.997x ➖ · cold 0.994x ➖
Parquet (geomean): hot 1.008x ➖ · cold 1.007x ➖
Shifts: Parquet (control) +0.8% · Median polish -0.1%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.998x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	344560650 / 351176788 / -1.9%	518454622 / 463596082 / +11.8% 🔴	0.66 / 0.76 / -12.3%
tpch_q02/datafusion:vortex-file-compressed	95263134 / 95959850 / -0.7%	175662993 / 180660693 / -2.8%	0.54 / 0.53 / +2.1%
tpch_q03/datafusion:vortex-file-compressed	137818806 / 138831395 / -0.7%	284558609 / 275869334 / +3.1%	0.48 / 0.50 / -3.8%
tpch_q04/datafusion:vortex-file-compressed	59183228 / 58375276 / +1.4%	145072094 / 143331014 / +1.2%	0.41 / 0.41 / +0.2%
tpch_q05/datafusion:vortex-file-compressed	267696768 / 265014869 / +1.0%	462386957 / 461859480 / +0.1%	0.58 / 0.57 / +0.9%
tpch_q06/datafusion:vortex-file-compressed	22785650 / 23244523 / -2.0%	131732155 / 153152827 / -14.0% 🟢	0.17 / 0.15 / +14.0%
tpch_q07/datafusion:vortex-file-compressed	351956719 / 350682795 / +0.4%	500649512 / 496600734 / +0.8%	0.70 / 0.71 / -0.4%
tpch_q08/datafusion:vortex-file-compressed	266819808 / 271932240 / -1.9%	497522752 / 474449328 / +4.9%	0.54 / 0.57 / -6.4%
tpch_q09/datafusion:vortex-file-compressed	499478125 / 466563006 / +7.1%	626418166 / 717468216 / -12.7% 🟢	0.80 / 0.65 / +22.6%
tpch_q10/datafusion:vortex-file-compressed	160008544 / 163160118 / -1.9%	323952526 / 307960669 / +5.2%	0.49 / 0.53 / -6.8%
tpch_q11/datafusion:vortex-file-compressed	69639325 / 69350371 / +0.4%	134611321 / 134922156 / -0.2%	0.52 / 0.51 / +0.6%
tpch_q12/datafusion:vortex-file-compressed	77315510 / 79654223 / -2.9%	177467896 / 173756341 / +2.1%	0.44 / 0.46 / -5.0%
tpch_q13/datafusion:vortex-file-compressed	116964771 / 113906440 / +2.7%	194590808 / 190313427 / +2.2%	0.60 / 0.60 / +0.4%
tpch_q14/datafusion:vortex-file-compressed	38946118 / 38775040 / +0.4%	173965346 / 180134575 / -3.4%	0.22 / 0.22 / +4.0%
tpch_q15/datafusion:vortex-file-compressed	66671431 / 68295132 / -2.4%	192447777 / 186329659 / +3.3%	0.35 / 0.37 / -5.5%
tpch_q16/datafusion:vortex-file-compressed	60134919 / 59822277 / +0.5%	135122996 / 137357621 / -1.6%	0.45 / 0.44 / +2.2%
tpch_q17/datafusion:vortex-file-compressed	404505129 / 410309657 / -1.4%	553038815 / 530014326 / +4.3%	0.73 / 0.77 / -5.5%
tpch_q18/datafusion:vortex-file-compressed	597192537 / 619094356 / -3.5%	793067223 / 780735385 / +1.6%	0.75 / 0.79 / -5.0%
tpch_q19/datafusion:vortex-file-compressed	53363632 / 53392970 / -0.1%	169379085 / 171784349 / -1.4%	0.32 / 0.31 / +1.4%
tpch_q20/datafusion:vortex-file-compressed	124514390 / 124307333 / +0.2%	266760696 / 246856652 / +8.1%	0.47 / 0.50 / -7.3%
tpch_q21/datafusion:vortex-file-compressed	427871310 / 423674521 / +1.0%	544706049 / 574357304 / -5.2%	0.79 / 0.74 / +6.5%
tpch_q22/datafusion:vortex-file-compressed	36648248 / 36254759 / +1.1%	96008025 / 101151965 / -5.1%	0.38 / 0.36 / +6.5%

datafusion / parquet / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	320792594 / 323331865 / -0.8%	404750437 / 414063428 / -2.2%	0.79 / 0.78 / +1.5%
tpch_q02/datafusion:parquet	182759099 / 190741941 / -4.2%	271406358 / 255636916 / +6.2%	0.67 / 0.75 / -9.8%
tpch_q03/datafusion:parquet	211045037 / 212748286 / -0.8%	347790416 / 358627154 / -3.0%	0.61 / 0.59 / +2.3%
tpch_q04/datafusion:parquet	88491663 / 89169867 / -0.8%	184052514 / 190571995 / -3.4%	0.48 / 0.47 / +2.8%
tpch_q05/datafusion:parquet	341810130 / 342798009 / -0.3%	508190522 / 508299129 / -0.0%	0.67 / 0.67 / -0.3%
tpch_q06/datafusion:parquet	66757651 / 68060350 / -1.9%	168168599 / 165072475 / +1.9%	0.40 / 0.41 / -3.7%
tpch_q07/datafusion:parquet	483309537 / 481073205 / +0.5%	661808898 / 666056118 / -0.6%	0.73 / 0.72 / +1.1%
tpch_q08/datafusion:parquet	374014664 / 377112935 / -0.8%	544518943 / 550867020 / -1.2%	0.69 / 0.68 / +0.3%
tpch_q09/datafusion:parquet	633748666 / 647701110 / -2.2%	828649145 / 846334169 / -2.1%	0.76 / 0.77 / -0.1%
tpch_q10/datafusion:parquet	508711538 / 514148192 / -1.1%	692385514 / 686688119 / +0.8%	0.73 / 0.75 / -1.9%
tpch_q11/datafusion:parquet	127189509 / 126910914 / +0.2%	208445243 / 212951065 / -2.1%	0.61 / 0.60 / +2.4%
tpch_q12/datafusion:parquet	138750699 / 138888100 / -0.1%	260563284 / 251599230 / +3.6%	0.53 / 0.55 / -3.5%
tpch_q13/datafusion:parquet	332400802 / 333011701 / -0.2%	416310467 / 405509410 / +2.7%	0.80 / 0.82 / -2.8%
tpch_q14/datafusion:parquet	114201579 / 111130826 / +2.8%	235565646 / 244707167 / -3.7%	0.48 / 0.45 / +6.8%
tpch_q15/datafusion:parquet	183579163 / 185708920 / -1.1%	293639902 / 291744833 / +0.6%	0.63 / 0.64 / -1.8%
tpch_q16/datafusion:parquet	120460006 / 120201999 / +0.2%	203482029 / 204820276 / -0.7%	0.59 / 0.59 / +0.9%
tpch_q17/datafusion:parquet	442577648 / 443567572 / -0.2%	568111330 / 571440219 / -0.6%	0.78 / 0.78 / +0.4%
tpch_q18/datafusion:parquet	651214280 / 658837003 / -1.2%	846662634 / 845866286 / +0.1%	0.77 / 0.78 / -1.2%
tpch_q19/datafusion:parquet	180312773 / 176939073 / +1.9%	305492251 / 311384307 / -1.9%	0.59 / 0.57 / +3.9%
tpch_q20/datafusion:parquet	273644315 / 271662502 / +0.7%	389789270 / 393635919 / -1.0%	0.70 / 0.69 / +1.7%
tpch_q21/datafusion:parquet	548978476 / 553143224 / -0.8%	789286364 / 780046086 / +1.2%	0.70 / 0.71 / -1.9%
tpch_q22/datafusion:parquet	224579865 / 223863078 / +0.3%	290655788 / 280520783 / +3.6%	0.77 / 0.80 / -3.2%

duckdb / vortex-file-compressed / ns (0.995x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	100138072 / 104947085 / -4.6%	193374717 / 196396659 / -1.5%	0.52 / 0.53 / -3.1%
tpch_q02/duckdb:vortex-file-compressed	69047308 / 67002770 / +3.1%	110940321 / 111838942 / -0.8%	0.62 / 0.60 / +3.9%
tpch_q03/duckdb:vortex-file-compressed	124719354 / 130069004 / -4.1%	239676573 / 246006938 / -2.6%	0.52 / 0.53 / -1.6%
tpch_q04/duckdb:vortex-file-compressed	162164215 / 161623818 / +0.3%	243321672 / 258243502 / -5.8%	0.67 / 0.63 / +6.5%
tpch_q05/duckdb:vortex-file-compressed	140376145 / 142211821 / -1.3%	254949396 / 237913889 / +7.2%	0.55 / 0.60 / -7.9%
tpch_q06/duckdb:vortex-file-compressed	37887013 / 37906659 / -0.1%	126777646 / 130087606 / -2.5%	0.30 / 0.29 / +2.6%
tpch_q07/duckdb:vortex-file-compressed	123061472 / 121152885 / +1.6%	257792342 / 270473632 / -4.7%	0.48 / 0.45 / +6.6%
tpch_q08/duckdb:vortex-file-compressed	174037605 / 177737148 / -2.1%	294927823 / 287492658 / +2.6%	0.59 / 0.62 / -4.6%
tpch_q09/duckdb:vortex-file-compressed	306865952 / 303620549 / +1.1%	440190444 / 428593885 / +2.7%	0.70 / 0.71 / -1.6%
tpch_q10/duckdb:vortex-file-compressed	221970006 / 215255903 / +3.1%	396286447 / 380171527 / +4.2%	0.56 / 0.57 / -1.1%
tpch_q11/duckdb:vortex-file-compressed	39328146 / 40418175 / -2.7%	82815190 / 97867723 / -15.4% 🟢	0.47 / 0.41 / +15.0%
tpch_q12/duckdb:vortex-file-compressed	112379121 / 110957592 / +1.3%	190593759 / 189994884 / +0.3%	0.59 / 0.58 / +1.0%
tpch_q13/duckdb:vortex-file-compressed	196648831 / 199043822 / -1.2%	291134071 / 290421236 / +0.2%	0.68 / 0.69 / -1.4%
tpch_q14/duckdb:vortex-file-compressed	55318360 / 53914432 / +2.6%	179017606 / 165251484 / +8.3%	0.31 / 0.33 / -5.3%
tpch_q15/duckdb:vortex-file-compressed	76536490 / 75078059 / +1.9%	179909087 / 179530683 / +0.2%	0.43 / 0.42 / +1.7%
tpch_q16/duckdb:vortex-file-compressed	84590948 / 85198595 / -0.7%	119888840 / 119613972 / +0.2%	0.71 / 0.71 / -0.9%
tpch_q17/duckdb:vortex-file-compressed	112038075 / 116256716 / -3.6%	295087156 / 293641522 / +0.5%	0.38 / 0.40 / -4.1%
tpch_q18/duckdb:vortex-file-compressed	276557517 / 268185771 / +3.1%	341806886 / 331647617 / +3.1%	0.81 / 0.81 / +0.1%
tpch_q19/duckdb:vortex-file-compressed	84361402 / 87267896 / -3.3%	210952098 / 205192592 / +2.8%	0.40 / 0.43 / -6.0%
tpch_q20/duckdb:vortex-file-compressed	127286866 / 129669802 / -1.8%	251094679 / 263551437 / -4.7%	0.51 / 0.49 / +3.0%
tpch_q21/duckdb:vortex-file-compressed	474269266 / 470383026 / +0.8%	533639248 / 564769416 / -5.5%	0.89 / 0.83 / +6.7%
tpch_q22/duckdb:vortex-file-compressed	73261290 / 75490347 / -3.0%	121215595 / 133532079 / -9.2%	0.60 / 0.57 / +6.9%

duckdb / parquet / ns (1.021x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	153094407 / 97913154 / +56.4% 🔴	184909688 / 144925140 / +27.6% 🔴	0.83 / 0.68 / +22.5%
tpch_q02/duckdb:parquet	101889142 / 102442128 / -0.5%	119252396 / 116256269 / +2.6%	0.85 / 0.88 / -3.0%
tpch_q03/duckdb:parquet	167512109 / 159845960 / +4.8%	249645451 / 220912783 / +13.0% 🔴	0.67 / 0.72 / -7.3%
tpch_q04/duckdb:parquet	119137591 / 119048078 / +0.1%	153087521 / 155643709 / -1.6%	0.78 / 0.76 / +1.7%
tpch_q05/duckdb:parquet	186015432 / 183424908 / +1.4%	247828374 / 266289211 / -6.9%	0.75 / 0.69 / +9.0%
tpch_q06/duckdb:parquet	57138506 / 55498320 / +3.0%	91113616 / 95722176 / -4.8%	0.63 / 0.58 / +8.2%
tpch_q07/duckdb:parquet	142172349 / 146919825 / -3.2%	240471490 / 223580948 / +7.6%	0.59 / 0.66 / -10.0%
tpch_q08/duckdb:parquet	219275752 / 218874475 / +0.2%	290427290 / 297031595 / -2.2%	0.76 / 0.74 / +2.5%
tpch_q09/duckdb:parquet	346765527 / 350062356 / -0.9%	432515464 / 432111250 / +0.1%	0.80 / 0.81 / -1.0%
tpch_q10/duckdb:parquet	650890139 / 651220988 / -0.1%	736873174 / 725537477 / +1.6%	0.88 / 0.90 / -1.6%
tpch_q11/duckdb:parquet	41684646 / 42028352 / -0.8%	54417292 / 54012904 / +0.7%	0.77 / 0.78 / -1.6%
tpch_q12/duckdb:parquet	115998701 / 115931112 / +0.1%	151782627 / 150408931 / +0.9%	0.76 / 0.77 / -0.8%
tpch_q13/duckdb:parquet	399636306 / 397650306 / +0.5%	432233143 / 431781735 / +0.1%	0.92 / 0.92 / +0.4%
tpch_q14/duckdb:parquet	152710226 / 152512814 / +0.1%	214809979 / 216704896 / -0.9%	0.71 / 0.70 / +1.0%
tpch_q15/duckdb:parquet	80039472 / 77565631 / +3.2%	121717152 / 127961970 / -4.9%	0.66 / 0.61 / +8.5%
tpch_q16/duckdb:parquet	154945928 / 155441841 / -0.3%	174589366 / 174738544 / -0.1%	0.89 / 0.89 / -0.2%
tpch_q17/duckdb:parquet	114358040 / 129519412 / -11.7% 🟢	207292785 / 198952090 / +4.2%	0.55 / 0.65 / -15.3%
tpch_q18/duckdb:parquet	292730341 / 300636542 / -2.6%	283710884 / 300128632 / -5.5%	1.03 / 1.00 / +3.0%
tpch_q19/duckdb:parquet	245997446 / 225916597 / +8.9%	318489463 / 318120471 / +0.1%	0.77 / 0.71 / +8.8%
tpch_q20/duckdb:parquet	196684731 / 198250404 / -0.8%	271883106 / 274537904 / -1.0%	0.72 / 0.72 / +0.2%
tpch_q21/duckdb:parquet	435652709 / 426630621 / +2.1%	520966079 / 481809684 / +8.1%	0.84 / 0.89 / -5.6%
tpch_q22/duckdb:parquet	337028827 / 337193868 / -0.0%	359798434 / 359854786 / -0.0%	0.94 / 0.94 / -0.0%

No file size changes detected.

github-actions · 2026-08-27T18:27:51Z

Benchmarks: Statistical and Population Genetics 📖

Commits: PR ff4c1879 vs base 01f147a5
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +8.1%
Engines: DuckDB No clear signal (+8.1%, low confidence)
Vortex (geomean): hot 1.076x ➖ · cold 1.081x ➖
Parquet (geomean): hot 0.996x ➖ · cold 0.994x ➖
Shifts: Parquet (control) -0.4% · Median polish +4.0%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

duckdb / vortex-file-compressed / ns (1.076x ➖, 0↑ 4↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:vortex-file-compressed	16457408 / 15194826 / +8.3%	29878471 / 26478543 / +12.8% 🔴	0.55 / 0.57 / -4.0%
statpopgen_q01/duckdb:vortex-file-compressed	13369784 / 14526382 / -8.0%	17290294 / 21579683 / -19.9% 🟢	0.77 / 0.67 / +14.9%
statpopgen_q02/duckdb:vortex-file-compressed	602474150 / 621756050 / -3.1%	709002421 / 648748202 / +9.3%	0.85 / 0.96 / -11.3%
statpopgen_q03/duckdb:vortex-file-compressed	1677305920 / 1323251997 / +26.8% 🔴	1378530239 / 1423373394 / -3.2%	1.22 / 0.93 / +30.9%
statpopgen_q04/duckdb:vortex-file-compressed	1630686340 / 1373969810 / +18.7% 🔴	1359007270 / 1416579844 / -4.1%	1.20 / 0.97 / +23.7%
statpopgen_q05/duckdb:vortex-file-compressed	736167301 / 636242244 / +15.7% 🔴	925796324 / 763229310 / +21.3% 🔴	0.80 / 0.83 / -4.6%
statpopgen_q06/duckdb:vortex-file-compressed	1839560496 / 1877383687 / -2.0%	2489906323 / 1885329391 / +32.1% 🔴	0.74 / 1.00 / -25.8%
statpopgen_q07/duckdb:vortex-file-compressed	272103616 / 249170576 / +9.2%	369160457 / 300643971 / +22.8% 🔴	0.74 / 0.83 / -11.1%
statpopgen_q08/duckdb:vortex-file-compressed	303158538 / 282293004 / +7.4%	407286957 / 382468491 / +6.5%	0.74 / 0.74 / +0.8%
statpopgen_q09/duckdb:vortex-file-compressed	1217813616 / 1251606338 / -2.7%	1087121472 / 1313958552 / -17.3% 🟢	1.12 / 0.95 / +17.6%
statpopgen_q10/duckdb:vortex-file-compressed	3787605990 / 3177371166 / +19.2% 🔴	4453679019 / 2995853858 / +48.7% 🔴	0.85 / 1.06 / -19.8%

duckdb / parquet / ns (0.996x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
statpopgen_q00/duckdb:parquet	376266708 / 376877454 / -0.2%	378546751 / 378298892 / +0.1%	0.99 / 1.00 / -0.2%
statpopgen_q01/duckdb:parquet	464712304 / 466243836 / -0.3%	474446353 / 474016899 / +0.1%	0.98 / 0.98 / -0.4%
statpopgen_q02/duckdb:parquet	767840242 / 778885658 / -1.4%	811278917 / 820388808 / -1.1%	0.95 / 0.95 / -0.3%
statpopgen_q03/duckdb:parquet	1040890274 / 1057375336 / -1.6%	1098778905 / 1115309085 / -1.5%	0.95 / 0.95 / -0.1%
statpopgen_q04/duckdb:parquet	1043985982 / 1053699862 / -0.9%	1096684390 / 1104929931 / -0.7%	0.95 / 0.95 / -0.2%
statpopgen_q05/duckdb:parquet	779541398 / 767752609 / +1.5%	830501317 / 803720006 / +3.3%	0.94 / 0.96 / -1.7%
statpopgen_q06/duckdb:parquet	1012373408 / 1024132022 / -1.1%	1068124444 / 1066879574 / +0.1%	0.95 / 0.96 / -1.3%
statpopgen_q07/duckdb:parquet	953277008 / 939893916 / +1.4%	1136150588 / 1133572068 / +0.2%	0.84 / 0.83 / +1.2%
statpopgen_q08/duckdb:parquet	963068889 / 964787270 / -0.2%	1113923637 / 1143157933 / -2.6%	0.86 / 0.84 / +2.4%
statpopgen_q09/duckdb:parquet	987503015 / 1008612630 / -2.1%	1038601543 / 1079222982 / -3.8%	0.95 / 0.93 / +1.7%
statpopgen_q10/duckdb:parquet	1658353544 / 1657317686 / +0.1%	1681011825 / 1698571485 / -1.0%	0.99 / 0.98 / +1.1%

File Size Changes (1 files changed, +0.0% overall, 1↑ 0↓)

File	Scale	Format	Base	HEAD	Change	%
gnomad.genomes.v3.1.2.hgdp_tgp.chr21.vortex	100000	vortex-file-compressed	1.55 GB	1.55 GB	+330.88 KB	+0.0%

Totals:

vortex-file-compressed: 1.55 GB → 1.55 GB (+0.0%)

github-actions · 2026-08-27T18:29:43Z

Benchmarks: Clickbench on NVME 📖

Commits: PR ff4c1879 vs base 68d6573b
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.3%
Engines: DataFusion No clear signal (-0.9%, low confidence) · DuckDB No clear signal (+0.3%, low confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.983x ➖
Parquet (geomean): hot 0.997x ➖ · cold 0.995x ➖
Shifts: Parquet (control) -0.3% · Median polish -0.5%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.989x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed	1894167 / 1887504 / +0.4%	43938890 / 41338842 / +6.3%	0.04 / 0.05 / -5.6%
clickbench_q01/datafusion:vortex-file-compressed	12803179 / 12983678 / -1.4%	62546674 / 57705487 / +8.4%	0.20 / 0.22 / -9.0%
clickbench_q02/datafusion:vortex-file-compressed	26095092 / 26780704 / -2.6%	76278264 / 74990425 / +1.7%	0.34 / 0.36 / -4.2%
clickbench_q03/datafusion:vortex-file-compressed	27726700 / 27258784 / +1.7%	97413178 / 96867842 / +0.6%	0.28 / 0.28 / +1.1%
clickbench_q04/datafusion:vortex-file-compressed	158118063 / 159535039 / -0.9%	235871554 / 234766788 / +0.5%	0.67 / 0.68 / -1.4%
clickbench_q05/datafusion:vortex-file-compressed	214896316 / 220888650 / -2.7%	303960160 / 298034521 / +2.0%	0.71 / 0.74 / -4.6%
clickbench_q06/datafusion:vortex-file-compressed	1898865 / 1899468 / -0.0%	42467136 / 42032373 / +1.0%	0.04 / 0.05 / -1.1%
clickbench_q07/datafusion:vortex-file-compressed	18797617 / 18750904 / +0.2%	70261445 / 69425957 / +1.2%	0.27 / 0.27 / -0.9%
clickbench_q08/datafusion:vortex-file-compressed	216981682 / 230546905 / -5.9%	303811749 / 308273625 / -1.4%	0.71 / 0.75 / -4.5%
clickbench_q09/datafusion:vortex-file-compressed	339894680 / 347688110 / -2.2%	421852505 / 416129339 / +1.4%	0.81 / 0.84 / -3.6%
clickbench_q10/datafusion:vortex-file-compressed	66152113 / 67225430 / -1.6%	135777133 / 134613075 / +0.9%	0.49 / 0.50 / -2.4%
clickbench_q11/datafusion:vortex-file-compressed	86840680 / 86549084 / +0.3%	152416109 / 151964251 / +0.3%	0.57 / 0.57 / +0.0%
clickbench_q12/datafusion:vortex-file-compressed	197670274 / 199164236 / -0.8%	287634986 / 286585490 / +0.4%	0.69 / 0.69 / -1.1%
clickbench_q13/datafusion:vortex-file-compressed	339574404 / 332078224 / +2.3%	447036003 / 446891942 / +0.0%	0.76 / 0.74 / +2.2%
clickbench_q14/datafusion:vortex-file-compressed	197698793 / 200452182 / -1.4%	295593885 / 280348134 / +5.4%	0.67 / 0.72 / -6.5%
clickbench_q15/datafusion:vortex-file-compressed	182195131 / 185134309 / -1.6%	259500653 / 262451986 / -1.1%	0.70 / 0.71 / -0.5%
clickbench_q16/datafusion:vortex-file-compressed	467829046 / 472325749 / -1.0%	569109620 / 564504562 / +0.8%	0.82 / 0.84 / -1.8%
clickbench_q17/datafusion:vortex-file-compressed	453944008 / 472209360 / -3.9%	557501282 / 571177158 / -2.4%	0.81 / 0.83 / -1.5%
clickbench_q18/datafusion:vortex-file-compressed	878876713 / 886806573 / -0.9%	985909231 / 1032220764 / -4.5%	0.89 / 0.86 / +3.8%
clickbench_q19/datafusion:vortex-file-compressed	16372401 / 17223841 / -4.9%	89098897 / 88815980 / +0.3%	0.18 / 0.19 / -5.2%
clickbench_q20/datafusion:vortex-file-compressed	181967260 / 184539410 / -1.4%	385336977 / 386267814 / -0.2%	0.47 / 0.48 / -1.2%
clickbench_q21/datafusion:vortex-file-compressed	265061109 / 267717161 / -1.0%	469426464 / 468676448 / +0.2%	0.56 / 0.57 / -1.2%
clickbench_q22/datafusion:vortex-file-compressed	323469837 / 327409188 / -1.2%	595282191 / 609208390 / -2.3%	0.54 / 0.54 / +1.1%
clickbench_q23/datafusion:vortex-file-compressed	557097353 / 609590448 / -8.6%	926354953 / 845707681 / +9.5%	0.60 / 0.72 / -16.6%
clickbench_q24/datafusion:vortex-file-compressed	40321460 / 42062211 / -4.1%	115440996 / 116619646 / -1.0%	0.35 / 0.36 / -3.2%
clickbench_q25/datafusion:vortex-file-compressed	53983952 / 55168861 / -2.1%	123528030 / 119837192 / +3.1%	0.44 / 0.46 / -5.1%
clickbench_q26/datafusion:vortex-file-compressed	41679076 / 41805099 / -0.3%	118242832 / 119902079 / -1.4%	0.35 / 0.35 / +1.1%
clickbench_q27/datafusion:vortex-file-compressed	271649865 / 274432100 / -1.0%	448861162 / 449182018 / -0.1%	0.61 / 0.61 / -0.9%
clickbench_q28/datafusion:vortex-file-compressed	1441759175 / 1442232170 / -0.0%	1522690360 / 1586146609 / -4.0%	0.95 / 0.91 / +4.1%
clickbench_q29/datafusion:vortex-file-compressed	37914586 / 38675174 / -2.0%	95959924 / 91334244 / +5.1%	0.40 / 0.42 / -6.7%
clickbench_q30/datafusion:vortex-file-compressed	170197520 / 170718198 / -0.3%	268508437 / 265441496 / +1.2%	0.63 / 0.64 / -1.4%
clickbench_q31/datafusion:vortex-file-compressed	191915961 / 193140764 / -0.6%	324199919 / 325740804 / -0.5%	0.59 / 0.59 / -0.2%
clickbench_q32/datafusion:vortex-file-compressed	813609804 / 815386181 / -0.2%	929579718 / 944532718 / -1.6%	0.88 / 0.86 / +1.4%
clickbench_q33/datafusion:vortex-file-compressed	1003194390 / 1004494628 / -0.1%	1209754033 / 1181278561 / +2.4%	0.83 / 0.85 / -2.5%
clickbench_q34/datafusion:vortex-file-compressed	998163620 / 1026777825 / -2.8%	1191172940 / 1197253702 / -0.5%	0.84 / 0.86 / -2.3%
clickbench_q35/datafusion:vortex-file-compressed	151375571 / 149359184 / +1.4%	220225867 / 226076505 / -2.6%	0.69 / 0.66 / +4.0%
clickbench_q36/datafusion:vortex-file-compressed	55683077 / 57103540 / -2.5%	118546914 / 119637446 / -0.9%	0.47 / 0.48 / -1.6%
clickbench_q37/datafusion:vortex-file-compressed	29196010 / 28977406 / +0.8%	82646568 / 83892473 / -1.5%	0.35 / 0.35 / +2.3%
clickbench_q38/datafusion:vortex-file-compressed	15372234 / 15499628 / -0.8%	73709612 / 69677844 / +5.8%	0.21 / 0.22 / -6.2%
clickbench_q39/datafusion:vortex-file-compressed	111687512 / 112690044 / -0.9%	182293837 / 184905212 / -1.4%	0.61 / 0.61 / +0.5%
clickbench_q40/datafusion:vortex-file-compressed	13567629 / 13063495 / +3.9%	64565074 / 66914519 / -3.5%	0.21 / 0.20 / +7.6%
clickbench_q41/datafusion:vortex-file-compressed	12949398 / 12618972 / +2.6%	62067377 / 64877931 / -4.3%	0.21 / 0.19 / +7.3%
clickbench_q42/datafusion:vortex-file-compressed	13848318 / 13370410 / +3.6%	64557929 / 65022192 / -0.7%	0.21 / 0.21 / +4.3%

datafusion / parquet / ns (0.999x ➖, 0↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet	1857824 / 1893967 / -1.9%	77906606 / 81695222 / -4.6%	0.02 / 0.02 / +2.9%
clickbench_q01/datafusion:parquet	17784126 / 15828142 / +12.4% 🔴	113107030 / 114137664 / -0.9%	0.16 / 0.14 / +13.4%
clickbench_q02/datafusion:parquet	33063898 / 33141966 / -0.2%	130579769 / 135920003 / -3.9%	0.25 / 0.24 / +3.8%
clickbench_q03/datafusion:parquet	27151953 / 28030646 / -3.1%	135028305 / 135864823 / -0.6%	0.20 / 0.21 / -2.5%
clickbench_q04/datafusion:parquet	166951218 / 175361608 / -4.8%	295273724 / 299232631 / -1.3%	0.57 / 0.59 / -3.5%
clickbench_q05/datafusion:parquet	238612936 / 239679314 / -0.4%	360122000 / 374883595 / -3.9%	0.66 / 0.64 / +3.6%
clickbench_q06/datafusion:parquet	1880092 / 1905149 / -1.3%	76412924 / 76766222 / -0.5%	0.02 / 0.02 / -0.9%
clickbench_q07/datafusion:parquet	19037118 / 18022662 / +5.6%	120332284 / 116637134 / +3.2%	0.16 / 0.15 / +2.4%
clickbench_q08/datafusion:parquet	227106630 / 230036638 / -1.3%	374492666 / 377873519 / -0.9%	0.61 / 0.61 / -0.4%
clickbench_q09/datafusion:parquet	365088108 / 360726473 / +1.2%	505062369 / 516504557 / -2.2%	0.72 / 0.70 / +3.5%
clickbench_q10/datafusion:parquet	75698510 / 72854360 / +3.9%	186454820 / 191724305 / -2.7%	0.41 / 0.38 / +6.8%
clickbench_q11/datafusion:parquet	88315760 / 87605812 / +0.8%	213203804 / 210927782 / +1.1%	0.41 / 0.42 / -0.3%
clickbench_q12/datafusion:parquet	234875592 / 237983528 / -1.3%	363823597 / 369774097 / -1.6%	0.65 / 0.64 / +0.3%
clickbench_q13/datafusion:parquet	384332640 / 393940152 / -2.4%	537425591 / 553664192 / -2.9%	0.72 / 0.71 / +0.5%
clickbench_q14/datafusion:parquet	249469746 / 253434219 / -1.6%	394918943 / 388334328 / +1.7%	0.63 / 0.65 / -3.2%
clickbench_q15/datafusion:parquet	199688630 / 198366325 / +0.7%	324675186 / 326728281 / -0.6%	0.62 / 0.61 / +1.3%
clickbench_q16/datafusion:parquet	470032263 / 471497078 / -0.3%	619972345 / 629151196 / -1.5%	0.76 / 0.75 / +1.2%
clickbench_q17/datafusion:parquet	473668942 / 476388082 / -0.6%	619453649 / 627052410 / -1.2%	0.76 / 0.76 / +0.6%
clickbench_q18/datafusion:parquet	893633993 / 893509602 / +0.0%	1069426984 / 1073650578 / -0.4%	0.84 / 0.83 / +0.4%
clickbench_q19/datafusion:parquet	23031456 / 22588404 / +2.0%	121094690 / 123801069 / -2.2%	0.19 / 0.18 / +4.2%
clickbench_q20/datafusion:parquet	445419012 / 456693702 / -2.5%	608926171 / 620878202 / -1.9%	0.73 / 0.74 / -0.6%
clickbench_q21/datafusion:parquet	439532362 / 437152024 / +0.5%	608920287 / 593670445 / +2.6%	0.72 / 0.74 / -2.0%
clickbench_q22/datafusion:parquet	612479390 / 619341570 / -1.1%	832407754 / 844885690 / -1.5%	0.74 / 0.73 / +0.4%
clickbench_q23/datafusion:parquet	2452618360 / 2408683828 / +1.8%	2787628056 / 2863832374 / -2.7%	0.88 / 0.84 / +4.6%
clickbench_q24/datafusion:parquet	42555485 / 41605942 / +2.3%	143382053 / 143112279 / +0.2%	0.30 / 0.29 / +2.1%
clickbench_q25/datafusion:parquet	89491672 / 89422753 / +0.1%	200771438 / 200630902 / +0.1%	0.45 / 0.45 / +0.0%
clickbench_q26/datafusion:parquet	43797141 / 45846051 / -4.5%	140711112 / 142992542 / -1.6%	0.31 / 0.32 / -2.9%
clickbench_q27/datafusion:parquet	517885980 / 525950893 / -1.5%	685742482 / 688827518 / -0.4%	0.76 / 0.76 / -1.1%
clickbench_q28/datafusion:parquet	1529324748 / 1558637051 / -1.9%	1631592237 / 1647179662 / -0.9%	0.94 / 0.95 / -0.9%
clickbench_q29/datafusion:parquet	40087574 / 38974518 / +2.9%	141112412 / 151475889 / -6.8%	0.28 / 0.26 / +10.4%
clickbench_q30/datafusion:parquet	230030930 / 237228881 / -3.0%	383842147 / 388150477 / -1.1%	0.60 / 0.61 / -1.9%
clickbench_q31/datafusion:parquet	262359374 / 270959164 / -3.2%	433585254 / 435373334 / -0.4%	0.61 / 0.62 / -2.8%
clickbench_q32/datafusion:parquet	844961788 / 846238248 / -0.2%	1012537601 / 1012396988 / +0.0%	0.83 / 0.84 / -0.2%
clickbench_q33/datafusion:parquet	1074604046 / 1087993896 / -1.2%	1253176343 / 1327142573 / -5.6%	0.86 / 0.82 / +4.6%
clickbench_q34/datafusion:parquet	1089581167 / 1096364564 / -0.6%	1261606211 / 1289672842 / -2.2%	0.86 / 0.85 / +1.6%
clickbench_q35/datafusion:parquet	158138660 / 164054418 / -3.6%	290077464 / 293647478 / -1.2%	0.55 / 0.56 / -2.4%
clickbench_q36/datafusion:parquet	106466480 / 106980484 / -0.5%	215384775 / 215529593 / -0.1%	0.49 / 0.50 / -0.4%
clickbench_q37/datafusion:parquet	49847744 / 48538228 / +2.7%	145284205 / 143181544 / +1.5%	0.34 / 0.34 / +1.2%
clickbench_q38/datafusion:parquet	66166590 / 65820068 / +0.5%	169849407 / 168703905 / +0.7%	0.39 / 0.39 / -0.2%
clickbench_q39/datafusion:parquet	203094356 / 204514637 / -0.7%	324324915 / 325467722 / -0.4%	0.63 / 0.63 / -0.3%
clickbench_q40/datafusion:parquet	27426750 / 26826303 / +2.2%	123761999 / 124048813 / -0.2%	0.22 / 0.22 / +2.5%
clickbench_q41/datafusion:parquet	25010386 / 25106610 / -0.4%	120224653 / 119493046 / +0.6%	0.21 / 0.21 / -1.0%
clickbench_q42/datafusion:parquet	25717361 / 25612438 / +0.4%	117721153 / 117253493 / +0.4%	0.22 / 0.22 / +0.0%

duckdb / vortex-file-compressed / ns (0.999x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed	15590494 / 13117240 / +18.9% 🔴	76316238 / 72887656 / +4.7%	0.20 / 0.18 / +13.5%
clickbench_q01/duckdb:vortex-file-compressed	18122331 / 19670194 / -7.9%	99921237 / 104387600 / -4.3%	0.18 / 0.19 / -3.8%
clickbench_q02/duckdb:vortex-file-compressed	22263666 / 23574177 / -5.6%	108124936 / 121020338 / -10.7% 🟢	0.21 / 0.19 / +5.7%
clickbench_q03/duckdb:vortex-file-compressed	34286646 / 32937630 / +4.1%	108094279 / 104349543 / +3.6%	0.32 / 0.32 / +0.5%
clickbench_q04/duckdb:vortex-file-compressed	133449165 / 133367513 / +0.1%	206859874 / 211804761 / -2.3%	0.65 / 0.63 / +2.5%
clickbench_q05/duckdb:vortex-file-compressed	155638995 / 158632698 / -1.9%	237283393 / 242985787 / -2.3%	0.66 / 0.65 / +0.5%
clickbench_q06/duckdb:vortex-file-compressed	21520304 / 22387121 / -3.9%	94006881 / 101488878 / -7.4%	0.23 / 0.22 / +3.8%
clickbench_q07/duckdb:vortex-file-compressed	22893456 / 21057394 / +8.7%	101329735 / 101906650 / -0.6%	0.23 / 0.21 / +9.3%
clickbench_q08/duckdb:vortex-file-compressed	172235207 / 171226244 / +0.6%	282263720 / 290908003 / -3.0%	0.61 / 0.59 / +3.7%
clickbench_q09/duckdb:vortex-file-compressed	212047755 / 212339988 / -0.1%	328083483 / 336523784 / -2.5%	0.65 / 0.63 / +2.4%
clickbench_q10/duckdb:vortex-file-compressed	74767770 / 77974551 / -4.1%	180618224 / 177013743 / +2.0%	0.41 / 0.44 / -6.0%
clickbench_q11/duckdb:vortex-file-compressed	93395269 / 91201958 / +2.4%	186260320 / 198160406 / -6.0%	0.50 / 0.46 / +8.9%
clickbench_q12/duckdb:vortex-file-compressed	177174842 / 178013914 / -0.5%	288673845 / 300338367 / -3.9%	0.61 / 0.59 / +3.6%
clickbench_q13/duckdb:vortex-file-compressed	319142445 / 323384169 / -1.3%	438931524 / 440482532 / -0.4%	0.73 / 0.73 / -1.0%
clickbench_q14/duckdb:vortex-file-compressed	190991860 / 193149830 / -1.1%	310478412 / 301852205 / +2.9%	0.62 / 0.64 / -3.9%
clickbench_q15/duckdb:vortex-file-compressed	186182920 / 189889346 / -2.0%	289025595 / 298567865 / -3.2%	0.64 / 0.64 / +1.3%
clickbench_q16/duckdb:vortex-file-compressed	376897800 / 377551940 / -0.2%	491878569 / 497116171 / -1.1%	0.77 / 0.76 / +0.9%
clickbench_q17/duckdb:vortex-file-compressed	372902040 / 371521956 / +0.4%	485411032 / 486546909 / -0.2%	0.77 / 0.76 / +0.6%
clickbench_q18/duckdb:vortex-file-compressed	733314172 / 733127224 / +0.0%	837617393 / 885081749 / -5.4%	0.88 / 0.83 / +5.7%
clickbench_q19/duckdb:vortex-file-compressed	26738130 / 26503660 / +0.9%	111513505 / 126949454 / -12.2% 🟢	0.24 / 0.21 / +14.8%
clickbench_q20/duckdb:vortex-file-compressed	241991879 / 240456790 / +0.6%	446725362 / 431545789 / +3.5%	0.54 / 0.56 / -2.8%
clickbench_q21/duckdb:vortex-file-compressed	370475510 / 358729201 / +3.3%	642379143 / 657305795 / -2.3%	0.58 / 0.55 / +5.7%
clickbench_q22/duckdb:vortex-file-compressed	557950460 / 560908338 / -0.5%	944575677 / 954958988 / -1.1%	0.59 / 0.59 / +0.6%
clickbench_q23/duckdb:vortex-file-compressed	129963920 / 126747722 / +2.5%	231832761 / 245021249 / -5.4%	0.56 / 0.52 / +8.4%
clickbench_q24/duckdb:vortex-file-compressed	39688971 / 38875890 / +2.1%	97452025 / 93516323 / +4.2%	0.41 / 0.42 / -2.0%
clickbench_q25/duckdb:vortex-file-compressed	61249983 / 61714948 / -0.8%	146876612 / 136804896 / +7.4%	0.42 / 0.45 / -7.6%
clickbench_q26/duckdb:vortex-file-compressed	28408144 / 33551470 / -15.3% 🟢	92826017 / 95320121 / -2.6%	0.31 / 0.35 / -13.1%
clickbench_q27/duckdb:vortex-file-compressed	241335578 / 246528326 / -2.1%	516075738 / 544679498 / -5.3%	0.47 / 0.45 / +3.3%
clickbench_q28/duckdb:vortex-file-compressed	1214836498 / 1260873266 / -3.7%	1444047011 / 1453170795 / -0.6%	0.84 / 0.87 / -3.0%
clickbench_q29/duckdb:vortex-file-compressed	31682404 / 30413286 / +4.2%	113424372 / 109196084 / +3.9%	0.28 / 0.28 / +0.3%
clickbench_q30/duckdb:vortex-file-compressed	174544210 / 164954038 / +5.8%	293216669 / 297879619 / -1.6%	0.60 / 0.55 / +7.5%
clickbench_q31/duckdb:vortex-file-compressed	306730952 / 294557926 / +4.1%	424986366 / 497811544 / -14.6% 🟢	0.72 / 0.59 / +22.0%
clickbench_q32/duckdb:vortex-file-compressed	922903208 / 938307856 / -1.6%	1058383545 / 1073723406 / -1.4%	0.87 / 0.87 / -0.2%
clickbench_q33/duckdb:vortex-file-compressed	1058604333 / 1061516453 / -0.3%	1278912737 / 1304470226 / -2.0%	0.83 / 0.81 / +1.7%
clickbench_q34/duckdb:vortex-file-compressed	1085263983 / 1075672958 / +0.9%	1329811691 / 1405124050 / -5.4%	0.82 / 0.77 / +6.6%
clickbench_q35/duckdb:vortex-file-compressed	211682820 / 207783307 / +1.9%	293348638 / 307558041 / -4.6%	0.72 / 0.68 / +6.8%
clickbench_q36/duckdb:vortex-file-compressed	30681362 / 32714532 / -6.2%	102569301 / 120481723 / -14.9% 🟢	0.30 / 0.27 / +10.2%
clickbench_q37/duckdb:vortex-file-compressed	19283324 / 20509753 / -6.0%	86838656 / 104777848 / -17.1% 🟢	0.22 / 0.20 / +13.4%
clickbench_q38/duckdb:vortex-file-compressed	23234719 / 22414792 / +3.7%	90369743 / 114507616 / -21.1% 🟢	0.26 / 0.20 / +31.3%
clickbench_q39/duckdb:vortex-file-compressed	46392590 / 47432256 / -2.2%	126011984 / 145694464 / -13.5% 🟢	0.37 / 0.33 / +13.1%
clickbench_q40/duckdb:vortex-file-compressed	16766112 / 15796215 / +6.1%	83810749 / 98230661 / -14.7% 🟢	0.20 / 0.16 / +24.4%
clickbench_q41/duckdb:vortex-file-compressed	18592526 / 19477314 / -4.5%	83876825 / 71331037 / +17.6% 🔴	0.22 / 0.27 / -18.8%
clickbench_q42/duckdb:vortex-file-compressed	19205266 / 19287396 / -0.4%	79583157 / 88346750 / -9.9%	0.24 / 0.22 / +10.5%

duckdb / parquet / ns (0.995x ➖, 1↑ 1↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet	15171766 / 15870505 / -4.4%	42240950 / 39020983 / +8.3%	0.36 / 0.41 / -11.7%
clickbench_q01/duckdb:parquet	17594316 / 17684149 / -0.5%	38878850 / 39441987 / -1.4%	0.45 / 0.45 / +0.9%
clickbench_q02/duckdb:parquet	26613412 / 25713738 / +3.5%	56170350 / 57783588 / -2.8%	0.47 / 0.45 / +6.5%
clickbench_q03/duckdb:parquet	28408484 / 27740408 / +2.4%	91246412 / 88624754 / +3.0%	0.31 / 0.31 / -0.5%
clickbench_q04/duckdb:parquet	136444268 / 136395849 / +0.0%	186385137 / 173003777 / +7.7%	0.73 / 0.79 / -7.1%
clickbench_q05/duckdb:parquet	195061960 / 195269860 / -0.1%	256596921 / 252046597 / +1.8%	0.76 / 0.77 / -1.9%
clickbench_q06/duckdb:parquet	25278704 / 24944654 / +1.3%	46817303 / 47877664 / -2.2%	0.54 / 0.52 / +3.6%
clickbench_q07/duckdb:parquet	19398134 / 19849649 / -2.3%	39145624 / 39865764 / -1.8%	0.50 / 0.50 / -0.5%
clickbench_q08/duckdb:parquet	171688262 / 172401630 / -0.4%	255359178 / 252009347 / +1.3%	0.67 / 0.68 / -1.7%
clickbench_q09/duckdb:parquet	225892514 / 227751330 / -0.8%	308698611 / 311864817 / -1.0%	0.73 / 0.73 / +0.2%
clickbench_q10/duckdb:parquet	65527000 / 64278678 / +1.9%	119693700 / 113798804 / +5.2%	0.55 / 0.56 / -3.1%
clickbench_q11/duckdb:parquet	68326041 / 69754274 / -2.0%	132766039 / 126137615 / +5.3%	0.51 / 0.55 / -6.9%
clickbench_q12/duckdb:parquet	173600700 / 176452901 / -1.6%	272490064 / 276931449 / -1.6%	0.64 / 0.64 / -0.0%
clickbench_q13/duckdb:parquet	309488734 / 311309164 / -0.6%	417026346 / 425299427 / -1.9%	0.74 / 0.73 / +1.4%
clickbench_q14/duckdb:parquet	194402020 / 196771568 / -1.2%	283385649 / 281714403 / +0.6%	0.69 / 0.70 / -1.8%
clickbench_q15/duckdb:parquet	185390534 / 187158088 / -0.9%	227548694 / 234766104 / -3.1%	0.81 / 0.80 / +2.2%
clickbench_q16/duckdb:parquet	347211030 / 354113977 / -1.9%	469490831 / 482695989 / -2.7%	0.74 / 0.73 / +0.8%
clickbench_q17/duckdb:parquet	352618560 / 357081964 / -1.2%	450273532 / 498677155 / -9.7%	0.78 / 0.72 / +9.4%
clickbench_q18/duckdb:parquet	681273868 / 695916535 / -2.1%	865225624 / 881467037 / -1.8%	0.79 / 0.79 / -0.3%
clickbench_q19/duckdb:parquet	23394202 / 24101662 / -2.9%	67651862 / 65206907 / +3.7%	0.35 / 0.37 / -6.4%
clickbench_q20/duckdb:parquet	268403667 / 262448594 / +2.3%	470390639 / 446674727 / +5.3%	0.57 / 0.59 / -2.9%
clickbench_q21/duckdb:parquet	317613240 / 320332542 / -0.8%	627192074 / 606315906 / +3.4%	0.51 / 0.53 / -4.1%
clickbench_q22/duckdb:parquet	473383556 / 477074515 / -0.8%	773153320 / 767951417 / +0.7%	0.61 / 0.62 / -1.4%
clickbench_q23/duckdb:parquet	245878245 / 253378739 / -3.0%	323344589 / 330615433 / -2.2%	0.76 / 0.77 / -0.8%
clickbench_q24/duckdb:parquet	79509990 / 71066310 / +11.9% 🔴	122828275 / 131817091 / -6.8%	0.65 / 0.54 / +20.1%
clickbench_q25/duckdb:parquet	74725528 / 72791854 / +2.7%	180545756 / 173719733 / +3.9%	0.41 / 0.42 / -1.2%
clickbench_q26/duckdb:parquet	59142295 / 55271898 / +7.0%	100436630 / 97859501 / +2.6%	0.59 / 0.56 / +4.3%
clickbench_q27/duckdb:parquet	283172840 / 274572669 / +3.1%	507666681 / 528124783 / -3.9%	0.56 / 0.52 / +7.3%
clickbench_q28/duckdb:parquet	1687898520 / 1735793880 / -2.8%	2134270643 / 2187026871 / -2.4%	0.79 / 0.79 / -0.4%
clickbench_q29/duckdb:parquet	25803533 / 28678208 / -10.0% 🟢	59497058 / 57813105 / +2.9%	0.43 / 0.50 / -12.6%
clickbench_q30/duckdb:parquet	184210596 / 181592756 / +1.4%	337741771 / 329770366 / +2.4%	0.55 / 0.55 / -1.0%
clickbench_q31/duckdb:parquet	315144232 / 313622969 / +0.5%	589185819 / 543816554 / +8.3%	0.53 / 0.58 / -7.3%
clickbench_q32/duckdb:parquet	904564085 / 916832237 / -1.3%	1028765413 / 1063908313 / -3.3%	0.88 / 0.86 / +2.0%
clickbench_q33/duckdb:parquet	792683284 / 807075862 / -1.8%	1071932533 / 1054979858 / +1.6%	0.74 / 0.77 / -3.3%
clickbench_q34/duckdb:parquet	799192506 / 786835820 / +1.6%	1027733025 / 981103787 / +4.8%	0.78 / 0.80 / -3.0%
clickbench_q35/duckdb:parquet	209819102 / 208897916 / +0.4%	243924982 / 251024234 / -2.8%	0.86 / 0.83 / +3.4%
clickbench_q36/duckdb:parquet	52398986 / 49881554 / +5.0%	72137720 / 69456693 / +3.9%	0.73 / 0.72 / +1.1%
clickbench_q37/duckdb:parquet	37057625 / 37693316 / -1.7%	55113841 / 57495109 / -4.1%	0.67 / 0.66 / +2.6%
clickbench_q38/duckdb:parquet	40325861 / 41106994 / -1.9%	58553640 / 58871626 / -0.5%	0.69 / 0.70 / -1.4%
clickbench_q39/duckdb:parquet	85428452 / 90805489 / -5.9%	112142162 / 132847603 / -15.6% 🟢	0.76 / 0.68 / +11.4%
clickbench_q40/duckdb:parquet	20733718 / 21096528 / -1.7%	42844958 / 41833326 / +2.4%	0.48 / 0.50 / -4.0%
clickbench_q41/duckdb:parquet	20359016 / 20288736 / +0.3%	42062531 / 42041304 / +0.1%	0.48 / 0.48 / +0.3%
clickbench_q42/duckdb:parquet	23998218 / 26241122 / -8.5%	46916516 / 45140582 / +3.9%	0.51 / 0.58 / -12.0%

No file size changes detected.

github-actions · 2026-08-27T18:30:10Z

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR ff4c1879 vs base 68d6573b
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.2%
Engines: DataFusion No clear signal (+8.9%, environment too noisy confidence) · DuckDB No clear signal (-2.2%, environment too noisy confidence)
Vortex (geomean): hot 0.994x ➖ · cold 0.954x ➖
Parquet (geomean): hot 0.963x ➖ · cold 0.940x ➖
Shifts: Parquet (control) -3.7% · Median polish -3.9%

How to read Verdict and Engines

Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.045x ➖, 2↑ 3↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed	234351704 / 237663398 / -1.4%	1070138700 / 901924514 / +18.7%	0.22 / 0.26 / -16.9%
tpch_q02/datafusion:vortex-file-compressed	337497368 / 319707763 / +5.6%	680479295 / 677526397 / +0.4%	0.50 / 0.47 / +5.1%
tpch_q03/datafusion:vortex-file-compressed	355979181 / 373568660 / -4.7%	1029721864 / 1469841261 / -29.9%	0.35 / 0.25 / +36.0%
tpch_q04/datafusion:vortex-file-compressed	165549952 / 175567270 / -5.7%	473735740 / 508844432 / -6.9%	0.35 / 0.35 / +1.3%
tpch_q05/datafusion:vortex-file-compressed	325846776 / 393730329 / -17.2%	561970673 / 789565944 / -28.8%	0.58 / 0.50 / +16.3%
tpch_q06/datafusion:vortex-file-compressed	261211927 / 274944338 / -5.0%	425613136 / 432420603 / -1.6%	0.61 / 0.64 / -3.5%
tpch_q07/datafusion:vortex-file-compressed	366931221 / 401355034 / -8.6%	581762544 / 747807464 / -22.2%	0.63 / 0.54 / +17.5%
tpch_q08/datafusion:vortex-file-compressed	387004264 / 454186584 / -14.8%	550517385 / 656503304 / -16.1%	0.70 / 0.69 / +1.6%
tpch_q09/datafusion:vortex-file-compressed	322610719 / 297246361 / +8.5%	720989945 / 534631099 / +34.9% 🔴	0.45 / 0.56 / -19.5%
tpch_q10/datafusion:vortex-file-compressed	2812052119 / 355320277 / +691.4% 🔴	3927322161 / 634171006 / +519.3% 🔴	0.72 / 0.56 / +27.8%
tpch_q11/datafusion:vortex-file-compressed	306179039 / 318436067 / -3.8%	479141977 / 419429699 / +14.2%	0.64 / 0.76 / -15.8%
tpch_q12/datafusion:vortex-file-compressed	320216981 / 407480740 / -21.4%	516568104 / 660978881 / -21.8%	0.62 / 0.62 / +0.6%
tpch_q13/datafusion:vortex-file-compressed	122993753 / 112497840 / +9.3%	434574306 / 362092674 / +20.0%	0.28 / 0.31 / -8.9%
tpch_q14/datafusion:vortex-file-compressed	194864143 / 176992848 / +10.1%	392036204 / 367589327 / +6.7%	0.50 / 0.48 / +3.2%
tpch_q15/datafusion:vortex-file-compressed	288466279 / 342661328 / -15.8%	488136298 / 725077538 / -32.7% 🟢	0.59 / 0.47 / +25.0%
tpch_q16/datafusion:vortex-file-compressed	164823854 / 183273354 / -10.1%	348683537 / 362175047 / -3.7%	0.47 / 0.51 / -6.6%
tpch_q17/datafusion:vortex-file-compressed	283348240 / 486897031 / -41.8% 🟢	506288276 / 725879492 / -30.3% 🟢	0.56 / 0.67 / -16.6%
tpch_q18/datafusion:vortex-file-compressed	402692747 / 240157593 / +67.7% 🔴	537125262 / 482233352 / +11.4%	0.75 / 0.50 / +50.5%
tpch_q19/datafusion:vortex-file-compressed	332684497 / 523582153 / -36.5% 🟢	528550056 / 511822935 / +3.3%	0.63 / 1.02 / -38.5%
tpch_q20/datafusion:vortex-file-compressed	286288838 / 311488318 / -8.1%	444832652 / 524602315 / -15.2%	0.64 / 0.59 / +8.4%
tpch_q21/datafusion:vortex-file-compressed	406580689 / 499200607 / -18.6%	593667593 / 649057486 / -8.5%	0.68 / 0.77 / -11.0%
tpch_q22/datafusion:vortex-file-compressed	271523182 / 161300550 / +68.3% 🔴	383771380 / 405379768 / -5.3%	0.71 / 0.40 / +77.8%

datafusion / parquet / ns (0.959x ➖, 1↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet	231277273 / 210500600 / +9.9%	625477119 / 556725749 / +12.3%	0.37 / 0.38 / -2.2%
tpch_q02/datafusion:parquet	286507804 / 283582550 / +1.0%	650731075 / 630297032 / +3.2%	0.44 / 0.45 / -2.1%
tpch_q03/datafusion:parquet	292152344 / 327173870 / -10.7%	882816894 / 786183387 / +12.3%	0.33 / 0.42 / -20.5%
tpch_q04/datafusion:parquet	144179724 / 197249320 / -26.9%	418346981 / 460135008 / -9.1%	0.34 / 0.43 / -19.6%
tpch_q05/datafusion:parquet	371800998 / 413184678 / -10.0%	565573577 / 547547302 / +3.3%	0.66 / 0.75 / -12.9%
tpch_q06/datafusion:parquet	155336473 / 146082318 / +6.3%	259602577 / 284963899 / -8.9%	0.60 / 0.51 / +16.7%
tpch_q07/datafusion:parquet	406084592 / 371603018 / +9.3%	571344208 / 490846927 / +16.4%	0.71 / 0.76 / -6.1%
tpch_q08/datafusion:parquet	451089987 / 452312852 / -0.3%	598930774 / 565627736 / +5.9%	0.75 / 0.80 / -5.8%
tpch_q09/datafusion:parquet	443750047 / 459814474 / -3.5%	689680309 / 695113853 / -0.8%	0.64 / 0.66 / -2.7%
tpch_q10/datafusion:parquet	424089439 / 446987437 / -5.1%	554926069 / 633568909 / -12.4%	0.76 / 0.71 / +8.3%
tpch_q11/datafusion:parquet	292658060 / 276522115 / +5.8%	499596106 / 496333401 / +0.7%	0.59 / 0.56 / +5.1%
tpch_q12/datafusion:parquet	204868398 / 220280871 / -7.0%	405671370 / 440740469 / -8.0%	0.51 / 0.50 / +1.0%
tpch_q13/datafusion:parquet	444558407 / 446742699 / -0.5%	719924552 / 663424042 / +8.5%	0.62 / 0.67 / -8.3%
tpch_q14/datafusion:parquet	177146887 / 200681724 / -11.7%	352146481 / 748977711 / -53.0% 🟢	0.50 / 0.27 / +87.7%
tpch_q15/datafusion:parquet	348147235 / 331795900 / +4.9%	495286756 / 500227803 / -1.0%	0.70 / 0.66 / +6.0%
tpch_q16/datafusion:parquet	152260554 / 118410008 / +28.6%	335525070 / 339772206 / -1.2%	0.45 / 0.35 / +30.2%
tpch_q17/datafusion:parquet	340326633 / 323807232 / +5.1%	600857900 / 431217509 / +39.3% 🔴	0.57 / 0.75 / -24.6%
tpch_q18/datafusion:parquet	425206754 / 465488045 / -8.7%	584088570 / 649844743 / -10.1%	0.73 / 0.72 / +1.6%
tpch_q19/datafusion:parquet	191532357 / 193018795 / -0.8%	338539559 / 343444359 / -1.4%	0.57 / 0.56 / +0.7%
tpch_q20/datafusion:parquet	255347701 / 311484931 / -18.0%	432176018 / 549925992 / -21.4%	0.59 / 0.57 / +4.3%
tpch_q21/datafusion:parquet	366295055 / 344610114 / +6.3%	541444874 / 480754161 / +12.6%	0.68 / 0.72 / -5.6%
tpch_q22/datafusion:parquet	174551456 / 290906340 / -40.0% 🟢	352880228 / 442161592 / -20.2%	0.49 / 0.66 / -24.8%

duckdb / vortex-file-compressed / ns (0.946x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed	214999986 / 212652652 / +1.1%	400347222 / 294029713 / +36.2% 🔴	0.54 / 0.72 / -25.7%
tpch_q02/duckdb:vortex-file-compressed	372213237 / 406202069 / -8.4%	428324599 / 633046722 / -32.3% 🟢	0.87 / 0.64 / +35.4%
tpch_q03/duckdb:vortex-file-compressed	417909607 / 456079398 / -8.4%	487975244 / 652030196 / -25.2%	0.86 / 0.70 / +22.4%
tpch_q04/duckdb:vortex-file-compressed	255117757 / 291795738 / -12.6%	291004569 / 413604816 / -29.6%	0.88 / 0.71 / +24.3%
tpch_q05/duckdb:vortex-file-compressed	395298700 / 405932904 / -2.6%	495352594 / 558476201 / -11.3%	0.80 / 0.73 / +9.8%
tpch_q06/duckdb:vortex-file-compressed	291473989 / 273167091 / +6.7%	299602356 / 273365153 / +9.6%	0.97 / 1.00 / -2.6%
tpch_q07/duckdb:vortex-file-compressed	466033966 / 464146239 / +0.4%	691170533 / 473974542 / +45.8% 🔴	0.67 / 0.98 / -31.1%
tpch_q08/duckdb:vortex-file-compressed	550866516 / 573119184 / -3.9%	575545777 / 636389969 / -9.6%	0.96 / 0.90 / +6.3%
tpch_q09/duckdb:vortex-file-compressed	472394264 / 505207933 / -6.5%	560093363 / 525656045 / +6.6%	0.84 / 0.96 / -12.2%
tpch_q10/duckdb:vortex-file-compressed	421838008 / 471387645 / -10.5%	464263382 / 1106288906 / -58.0% 🟢	0.91 / 0.43 / +113.2%
tpch_q11/duckdb:vortex-file-compressed	163550815 / 138231648 / +18.3%	188946509 / 183279807 / +3.1%	0.87 / 0.75 / +14.8%
tpch_q12/duckdb:vortex-file-compressed	381699200 / 413959507 / -7.8%	423709737 / 670607758 / -36.8% 🟢	0.90 / 0.62 / +45.9%
tpch_q13/duckdb:vortex-file-compressed	278342387 / 307695385 / -9.5%	294536708 / 379563473 / -22.4%	0.95 / 0.81 / +16.6%
tpch_q14/duckdb:vortex-file-compressed	234280663 / 248737358 / -5.8%	329659262 / 324850605 / +1.5%	0.71 / 0.77 / -7.2%
tpch_q15/duckdb:vortex-file-compressed	144616977 / 168997869 / -14.4%	239611409 / 284433698 / -15.8%	0.60 / 0.59 / +1.6%
tpch_q16/duckdb:vortex-file-compressed	190920005 / 200850161 / -4.9%	226169748 / 220064961 / +2.8%	0.84 / 0.91 / -7.5%
tpch_q17/duckdb:vortex-file-compressed	414959942 / 400734975 / +3.5%	441789588 / 502106489 / -12.0%	0.94 / 0.80 / +17.7%
tpch_q18/duckdb:vortex-file-compressed	290889171 / 342009789 / -14.9%	385810784 / 452289056 / -14.7%	0.75 / 0.76 / -0.3%
tpch_q19/duckdb:vortex-file-compressed	322460222 / 367069298 / -12.2%	400925243 / 389977004 / +2.8%	0.80 / 0.94 / -14.6%
tpch_q20/duckdb:vortex-file-compressed	379967570 / 383113212 / -0.8%	664543504 / 494284057 / +34.4% 🔴	0.57 / 0.78 / -26.2%
tpch_q21/duckdb:vortex-file-compressed	581332596 / 674522005 / -13.8%	671861247 / 708811555 / -5.2%	0.87 / 0.95 / -9.1%
tpch_q22/duckdb:vortex-file-compressed	119989442 / 126538869 / -5.2%	139801210 / 172887434 / -19.1%	0.86 / 0.73 / +17.3%

duckdb / parquet / ns (0.967x ➖, 0↑ 0↓)

name	hot ns (PR / base / %diff)	cold ns (PR / base / %diff)	hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet	324928546 / 380511031 / -14.6%	375097688 / 393235421 / -4.6%	0.87 / 0.97 / -10.5%
tpch_q02/duckdb:parquet	676818194 / 694181477 / -2.5%	768216889 / 829582749 / -7.4%	0.88 / 0.84 / +5.3%
tpch_q03/duckdb:parquet	758154015 / 860661058 / -11.9%	912104834 / 897174272 / +1.7%	0.83 / 0.96 / -13.4%
tpch_q04/duckdb:parquet	481124320 / 529285406 / -9.1%	515501740 / 701297548 / -26.5%	0.93 / 0.75 / +23.7%
tpch_q05/duckdb:parquet	1020429668 / 984349848 / +3.7%	1131484584 / 1034701717 / +9.4%	0.90 / 0.95 / -5.2%
tpch_q06/duckdb:parquet	307345764 / 400920843 / -23.3%	324726693 / 341690706 / -5.0%	0.95 / 1.17 / -19.3%
tpch_q07/duckdb:parquet	926372293 / 909281618 / +1.9%	897773005 / 889948834 / +0.9%	1.03 / 1.02 / +1.0%
tpch_q08/duckdb:parquet	1086916991 / 1130892041 / -3.9%	1124369463 / 1273266668 / -11.7%	0.97 / 0.89 / +8.8%
tpch_q09/duckdb:parquet	1082719103 / 1053876635 / +2.7%	1165215586 / 989547255 / +17.8%	0.93 / 1.07 / -12.8%
tpch_q10/duckdb:parquet	1033405330 / 1114697009 / -7.3%	991413922 / 1078784195 / -8.1%	1.04 / 1.03 / +0.9%
tpch_q11/duckdb:parquet	493071439 / 513197184 / -3.9%	522146723 / 435836993 / +19.8%	0.94 / 1.18 / -19.8%
tpch_q12/duckdb:parquet	596727824 / 626229541 / -4.7%	781534694 / 605777422 / +29.0%	0.76 / 1.03 / -26.1%
tpch_q13/duckdb:parquet	865471971 / 864159822 / +0.2%	1092755879 / 1764165165 / -38.1% 🟢	0.79 / 0.49 / +61.7%
tpch_q14/duckdb:parquet	520065858 / 583052259 / -10.8%	524127187 / 575384533 / -8.9%	0.99 / 1.01 / -2.1%
tpch_q15/duckdb:parquet	397701718 / 398997706 / -0.3%	360627406 / 700049146 / -48.5% 🟢	1.10 / 0.57 / +93.5%
tpch_q16/duckdb:parquet	551865018 / 510358485 / +8.1%	520472300 / 584762045 / -11.0%	1.06 / 0.87 / +21.5%
tpch_q17/duckdb:parquet	511502440 / 529487495 / -3.4%	486592253 / 529175563 / -8.0%	1.05 / 1.00 / +5.1%
tpch_q18/duckdb:parquet	692585521 / 707302621 / -2.1%	706122828 / 786227814 / -10.2%	0.98 / 0.90 / +9.0%
tpch_q19/duckdb:parquet	604702662 / 650393747 / -7.0%	596510879 / 990339909 / -39.8% 🟢	1.01 / 0.66 / +54.4%
tpch_q20/duckdb:parquet	900480411 / 850273315 / +5.9%	836901251 / 967953758 / -13.5%	1.08 / 0.88 / +22.5%
tpch_q21/duckdb:parquet	780642643 / 749197776 / +4.2%	830033830 / 750205473 / +10.6%	0.94 / 1.00 / -5.8%
tpch_q22/duckdb:parquet	509121254 / 451428612 / +12.8%	478587089 / 447047269 / +7.1%	1.06 / 1.01 / +5.3%

Signed-off-by: Matt Katz <mhkatz97@gmail.com>

mhk197 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 27, 2026

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 27, 2026

mhk197 changed the title ~~Simplify ListLayout page structure~~ Simplify ListLayout and enable for benchmarks Aug 27, 2026

mhk197 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 27, 2026

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 27, 2026

mhk197 force-pushed the mk/simplify-list-layout branch from 20c347d to ac9feeb Compare August 27, 2026 20:53

mhk197 changed the base branch from develop to mk/crop-list-filter-elements August 27, 2026 20:53

mhk197 marked this pull request as ready for review August 27, 2026 20:54

mhk197 force-pushed the mk/simplify-list-layout branch 2 times, most recently from 1ead11e to 55c872c Compare August 27, 2026 21:31

mhk197 force-pushed the mk/crop-list-filter-elements branch 3 times, most recently from dba7820 to ff9eddd Compare August 28, 2026 14:23

mhk197 force-pushed the mk/simplify-list-layout branch from 7a318cc to f85b81b Compare August 28, 2026 14:35

mhk197 added the changelog/skip Do not list PR in the changelog label Aug 28, 2026

mhk197 force-pushed the mk/crop-list-filter-elements branch 2 times, most recently from 3a40b1e to 6873b0d Compare August 28, 2026 18:13

Base automatically changed from mk/crop-list-filter-elements to develop August 28, 2026 18:58

mhk197 added 4 commits August 28, 2026 15:10

Simplify list layout page structure

822fd72

Signed-off-by: Matt Katz <mhkatz97@gmail.com>

Enable list layout with unstable encodings

6e23002

Signed-off-by: Matt Katz <mhkatz97@gmail.com>

simplify strategy

e00d8d8

Signed-off-by: Matt Katz <mhkatz97@gmail.com>

simplify

ff4c187

Signed-off-by: Matt Katz <mhkatz97@gmail.com>

mhk197 force-pushed the mk/simplify-list-layout branch from f85b81b to ff4c187 Compare August 28, 2026 19:12

mhk197 added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 28, 2026

github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Aug 28, 2026

Remove list layout default tests

d2fc075

Signed-off-by: Matt Katz <mhkatz97@gmail.com>

Navigation Menu

Uh oh!

Simplify `ListLayout` and enable for benchmarks - #9675

Simplify `ListLayout` and enable for benchmarks#9675
mhk197 wants to merge 5 commits into
developfrom
mk/simplify-list-layout

mhk197 commented Aug 27, 2026 •

edited

Loading

Uh oh!

codspeed-hq Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

github-actions Bot commented Aug 27, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Uh oh!

Conversation

mhk197 commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Local Benchmarks versus flat

Uh oh!

codspeed-hq Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merging this PR will regress 6 benchmarks

Performance Changes

Footnotes

Uh oh!

github-actions Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Polar Signals Profiling Results

Latest Run

Uh oh!

github-actions Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: PolarSignals Profiling 📖

Uh oh!

github-actions Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb NVMe 📖

Uh oh!

github-actions Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench Sorted on NVME 📖

Uh oh!

github-actions Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-DS SF=1 on NVME 📖

Uh oh!

github-actions Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: FineWeb S3 📖

Uh oh!

github-actions Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=10 on NVME 📖

Uh oh!

github-actions Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Statistical and Population Genetics 📖

Uh oh!

github-actions Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: Clickbench on NVME 📖

Uh oh!

github-actions Bot commented Aug 27, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks: TPC-H SF=1 on S3 📖

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

mhk197 commented Aug 27, 2026 •

edited

Loading

codspeed-hq Bot commented Aug 27, 2026 •

edited

Loading

github-actions Bot commented Aug 27, 2026 •

edited

Loading

github-actions Bot commented Aug 27, 2026 •

edited

Loading

github-actions Bot commented Aug 27, 2026 •

edited

Loading

github-actions Bot commented Aug 27, 2026 •

edited

Loading

github-actions Bot commented Aug 27, 2026 •

edited

Loading

github-actions Bot commented Aug 27, 2026 •

edited

Loading

github-actions Bot commented Aug 27, 2026 •

edited

Loading

github-actions Bot commented Aug 27, 2026 •

edited

Loading

github-actions Bot commented Aug 27, 2026 •

edited

Loading

github-actions Bot commented Aug 27, 2026 •

edited

Loading

github-actions Bot commented Aug 27, 2026 •

edited

Loading