Skip to content

array tree layout#7952

Open
onursatici wants to merge 8 commits into
developfrom
os/array-tree-layout
Open

array tree layout#7952
onursatici wants to merge 8 commits into
developfrom
os/array-tree-layout

Conversation

@onursatici
Copy link
Copy Markdown
Contributor

@onursatici onursatici commented May 15, 2026 •
edited
Loading

Summary

Introduce array tree layout that gathers the array tree flatbuffer definitions as a vortex array in a segment that resides just before the zone map segments. This supersedes the env var to embed the array trees into the footer.
env var is still supported but deprecated.

API Changes

  • Breaking: vortex_layout::VTable::new_reader gains a ctx: &LayoutReaderContext
    parameter. Out-of-tree implementors must add this one argument; intermediate layouts
    forward ctx to recursive Layout::new_reader_in_ctx calls on children, leaves can ignore
    it. Migration is adding that new ctx parameter per impl.
  • Deprecated: FLAT_LAYOUT_INLINE_ARRAY_NODE=1 env var continues to populate
    FlatLayout::array_tree inline metadata as before, but now emits a one-shot
    tracing::warn on first read directing users at with_array_tree(true). Will be removed
    once downstream tooling has migrated.

@codspeed-hq
Copy link
Copy Markdown

codspeed-hq Bot commented May 15, 2026 •
edited
Loading

Merging this PR will degrade performance by 14.28%

⚠️ Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.

For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

❌ 2 regressed benchmarks
✅ 1219 untouched benchmarks

Warning

Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
❌ Simulation new_alp_prim_test_between[f32, 16384] 103.8 µs 118.7 µs -12.51%
❌ Simulation new_alp_prim_test_between[f32, 32768] 153.2 µs 182.4 µs -16.02%

Tip

Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.

Comparing os/array-tree-layout (20d8b2e) with develop (52e26d1)

Open in CodSpeed

@onursatici onursatici added tldr and removed tldr labels May 18, 2026
@tl-dr-review tl-dr-review Bot added tldr and removed tldr labels May 18, 2026
@onursatici onursatici marked this pull request as ready for review May 18, 2026 15:06
@onursatici onursatici added the changelog/break A breaking API change label May 18, 2026
@tl-dr-review tl-dr-review Bot added tldr and removed tldr labels May 18, 2026
onursatici added 8 commits May 18, 2026 16:49
@onursatici
array tree layout
d080c1d
@onursatici
layout builder overrides
6991c01 
Signed-off-by: Onur Satici <onur@spiraldb.com>
@onursatici
tests
8c4f360 
Signed-off-by: Onur Satici <onur@spiraldb.com>
@onursatici
leaves send array trees to the parent instead of shared state
085c250 
Signed-off-by: Onur Satici <onur@spiraldb.com>
@onursatici
off by default, restore env var and deprecate
a63ae1b 
Signed-off-by: Onur Satici <onur@spiraldb.com>
@onursatici
compress the array tree segments
0ad3689
@onursatici
vortex web to work with array tree layouts
a5f6e71 
Signed-off-by: Onur Satici <onur@spiraldb.com>
@onursatici
tests, fix wasm swallowed error
20d8b2e 
Signed-off-by: Onur Satici <onur@spiraldb.com>
@onursatici onursatici force-pushed the os/array-tree-layout branch from 195519d to 20d8b2e Compare May 18, 2026 15:49
@joseph-isaacs joseph-isaacs added the action/benchmark Trigger full benchmarks to run on this PR label May 18, 2026
@github-actions github-actions Bot removed the action/benchmark Trigger full benchmarks to run on this PR label May 18, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026 •
edited
Loading

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done 20d8b2e 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.9%
Vortex (geomean): 0.989x ➖
Parquet (geomean): 0.998x ➖
Shifts: Parquet (control) -0.2% · Median polish -0.9%

datafusion / vortex-file-compressed (0.997x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5034609 5200391 0.97
fineweb_q01/datafusion:vortex-file-compressed 17920261 19873208 0.90
fineweb_q02/datafusion:vortex-file-compressed 21985049 21386389 1.03
fineweb_q03/datafusion:vortex-file-compressed 81671841 77076641 1.06
fineweb_q04/datafusion:vortex-file-compressed 220989070 226185804 0.98
fineweb_q05/datafusion:vortex-file-compressed 210252642 212680298 0.99
fineweb_q06/datafusion:vortex-file-compressed 52056438 50126777 1.04
fineweb_q07/datafusion:vortex-file-compressed 57170964 54431634 1.05
fineweb_q08/datafusion:vortex-file-compressed 20100873 20714594 0.97
datafusion / vortex-compact (0.991x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 6089002 5555349 1.10
fineweb_q01/datafusion:vortex-compact 92912503 97179152 0.96
fineweb_q02/datafusion:vortex-compact 104433325 112014124 0.93
fineweb_q03/datafusion:vortex-compact 845318902 863205931 0.98
fineweb_q04/datafusion:vortex-compact 916134239 917219651 1.00
fineweb_q05/datafusion:vortex-compact 829371361 825450378 1.00
fineweb_q06/datafusion:vortex-compact 468801554 467416921 1.00
fineweb_q07/datafusion:vortex-compact 480314410 474960058 1.01
fineweb_q08/datafusion:vortex-compact 17814185 18786993 0.95
datafusion / parquet (0.981x ➖, 1↑ 0↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 6094350 6823544 0.89
fineweb_q01/datafusion:parquet 285404133 292943952 0.97
fineweb_q02/datafusion:parquet 286189504 289167678 0.99
fineweb_q03/datafusion:parquet 291361327 280655762 1.04
fineweb_q04/datafusion:parquet 300546533 297364635 1.01
fineweb_q05/datafusion:parquet 292994533 299427007 0.98
fineweb_q06/datafusion:parquet 283905545 295161326 0.96
fineweb_q07/datafusion:parquet 282732249 284855671 0.99
fineweb_q08/datafusion:parquet 276082870 277755667 0.99
duckdb / vortex-file-compressed (0.952x ➖, 1↑ 0↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3069227 3152789 0.97
fineweb_q01/duckdb:vortex-file-compressed 21618221 21898931 0.99
fineweb_q02/duckdb:vortex-file-compressed 23666293 22853071 1.04
fineweb_q03/duckdb:vortex-file-compressed 🚀 114229750 161933165 0.71
fineweb_q04/duckdb:vortex-file-compressed 212638452 217852234 0.98
fineweb_q05/duckdb:vortex-file-compressed 211879457 213362402 0.99
fineweb_q06/duckdb:vortex-file-compressed 51127244 51723590 0.99
fineweb_q07/duckdb:vortex-file-compressed 53056759 53774340 0.99
fineweb_q08/duckdb:vortex-file-compressed 22216154 22900330 0.97
duckdb / vortex-compact (1.019x ➖, 0↑ 1↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 3809159 3782130 1.01
fineweb_q01/duckdb:vortex-compact 🚨 104572469 93262571 1.12
fineweb_q02/duckdb:vortex-compact 112019587 105042123 1.07
fineweb_q03/duckdb:vortex-compact 843591645 848718113 0.99
fineweb_q04/duckdb:vortex-compact 893374360 897358848 1.00
fineweb_q05/duckdb:vortex-compact 804209441 799310007 1.01
fineweb_q06/duckdb:vortex-compact 457997611 460263295 1.00
fineweb_q07/duckdb:vortex-compact 476410090 470472010 1.01
fineweb_q08/duckdb:vortex-compact 20136973 20591904 0.98
duckdb / parquet (1.016x ➖, 0↑ 1↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 30507853 30527439 1.00
fineweb_q01/duckdb:parquet 87266855 81660281 1.07
fineweb_q02/duckdb:parquet 84046217 83863519 1.00
fineweb_q03/duckdb:parquet 306693473 312602432 0.98
fineweb_q04/duckdb:parquet 440398328 439640396 1.00
fineweb_q05/duckdb:parquet 411043904 411017885 1.00
fineweb_q06/duckdb:parquet 197806616 198735500 1.00
fineweb_q07/duckdb:parquet 208273062 208811265 1.00
fineweb_q08/duckdb:parquet 🚨 32256017 29189359 1.11
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact +9.6% -5.5% +16.0% +51.9% ➖ noise
0 datafusion:vortex-file-compressed -3.2% -5.5% +2.5% +50.8% ➖ noise
0 duckdb:vortex-compact +0.7% -5.5% +6.6% +81.6% ➖ noise
0 duckdb:vortex-file-compressed -2.7% -5.5% +3.0% +90.7% ➖ noise
1 datafusion:vortex-compact -4.4% +2.0% -6.3% +32.5% ➖ noise
1 datafusion:vortex-file-compressed -9.8% +2.0% -11.6% +18.0% ➖ noise
1 duckdb:vortex-compact +12.1% +2.0% +9.9% +13.2% ➖ noise
1 duckdb:vortex-file-compressed -1.3% +2.0% -3.3% +60.7% ➖ noise
2 datafusion:vortex-compact -6.8% -0.4% -6.4% +13.6% ➖ noise
2 datafusion:vortex-file-compressed +2.8% -0.4% +3.2% +19.9% ➖ noise
2 duckdb:vortex-compact +6.6% -0.4% +7.1% +16.1% ➖ noise
2 duckdb:vortex-file-compressed +3.6% -0.4% +4.0% +10.0% ➖ noise
3 datafusion:vortex-compact -2.1% +0.9% -3.0% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +6.0% +0.9% +5.0% +32.0% ➖ noise
3 duckdb:vortex-compact -0.6% +0.9% -1.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -29.5% +0.9% -30.1% +39.0% ✅ faster
4 datafusion:vortex-compact -0.1% +0.6% -0.7% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -2.3% +0.6% -2.9% +10.0% ➖ noise
4 duckdb:vortex-compact -0.4% +0.6% -1.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.4% +0.6% -3.0% +10.0% ➖ noise
5 datafusion:vortex-compact +0.5% -1.1% +1.6% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -1.1% -1.1% -0.1% +10.0% ➖ noise
5 duckdb:vortex-compact +0.6% -1.1% +1.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -0.7% -1.1% +0.4% +10.0% ➖ noise
6 datafusion:vortex-compact +0.3% -2.2% +2.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +3.8% -2.2% +6.1% +10.0% ➖ noise
6 duckdb:vortex-compact -0.5% -2.2% +1.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -1.2% -2.2% +1.0% +10.0% ➖ noise
7 datafusion:vortex-compact +1.1% -0.5% +1.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +5.0% -0.5% +5.6% +10.0% ➖ noise
7 duckdb:vortex-compact +1.3% -0.5% +1.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -1.3% -0.5% -0.8% +17.1% ➖ noise
8 datafusion:vortex-compact -5.2% +4.8% -9.5% +14.0% ➖ noise
8 datafusion:vortex-file-compressed -3.0% +4.8% -7.4% +13.8% ➖ noise
8 duckdb:vortex-compact -2.2% +4.8% -6.7% +26.1% ➖ noise
8 duckdb:vortex-file-compressed -3.0% +4.8% -7.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 1.029x ➖

datafusion / vortex-file-compressed (1.029x ➖, 0↑ 1↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 120137449 122243607 0.98
polarsignals_q01/datafusion:vortex-file-compressed 261401040 271895579 0.96
polarsignals_q02/datafusion:vortex-file-compressed 22814448 22180684 1.03
polarsignals_q03/datafusion:vortex-file-compressed 🚨 304691965 270222172 1.13
polarsignals_q04/datafusion:vortex-file-compressed 11227186 10927432 1.03
polarsignals_q05/datafusion:vortex-file-compressed 14960381 14205751 1.05
polarsignals_q06/datafusion:vortex-file-compressed 17968742 17390514 1.03
polarsignals_q07/datafusion:vortex-file-compressed 13381143 12302759 1.09
polarsignals_q08/datafusion:vortex-file-compressed 407442037 398942377 1.02
polarsignals_q09/datafusion:vortex-file-compressed 10716732 10979661 0.98

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.3%
Vortex (geomean): 0.975x ➖
Parquet (geomean): 0.987x ➖
Shifts: Parquet (control) -1.3% · Median polish -2.3%

datafusion / vortex-file-compressed (0.968x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49042965 52929193 0.93
tpch_q02/datafusion:vortex-file-compressed 21834565 22675699 0.96
tpch_q03/datafusion:vortex-file-compressed 27695067 29392762 0.94
tpch_q04/datafusion:vortex-file-compressed 20132485 20256556 0.99
tpch_q05/datafusion:vortex-file-compressed 47792454 50142809 0.95
tpch_q06/datafusion:vortex-file-compressed 10307717 11053110 0.93
tpch_q07/datafusion:vortex-file-compressed 55579623 55340932 1.00
tpch_q08/datafusion:vortex-file-compressed 39469861 40736409 0.97
tpch_q09/datafusion:vortex-file-compressed 51980249 52144893 1.00
tpch_q10/datafusion:vortex-file-compressed 40082743 40663084 0.99
tpch_q11/datafusion:vortex-file-compressed 15804421 16671583 0.95
tpch_q12/datafusion:vortex-file-compressed 24592310 24472826 1.00
tpch_q13/datafusion:vortex-file-compressed 25369769 26210991 0.97
tpch_q14/datafusion:vortex-file-compressed 15731225 16296808 0.97
tpch_q15/datafusion:vortex-file-compressed 25086215 25223512 0.99
tpch_q16/datafusion:vortex-file-compressed 19736752 20145299 0.98
tpch_q17/datafusion:vortex-file-compressed 65859362 69008400 0.95
tpch_q18/datafusion:vortex-file-compressed 79017249 83652261 0.94
tpch_q19/datafusion:vortex-file-compressed 19698438 20878671 0.94
tpch_q20/datafusion:vortex-file-compressed 28733032 29996752 0.96
tpch_q21/datafusion:vortex-file-compressed 70244096 72922772 0.96
tpch_q22/datafusion:vortex-file-compressed 12721462 12674589 1.00
datafusion / vortex-compact (0.971x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 58855580 58458507 1.01
tpch_q02/datafusion:vortex-compact 25839766 25967994 1.00
tpch_q03/datafusion:vortex-compact 29558032 30427828 0.97
tpch_q04/datafusion:vortex-compact 22319574 23123075 0.97
tpch_q05/datafusion:vortex-compact 49540878 51667236 0.96
tpch_q06/datafusion:vortex-compact 12225810 12837204 0.95
tpch_q07/datafusion:vortex-compact 60407600 60922776 0.99
tpch_q08/datafusion:vortex-compact 42661963 44163419 0.97
tpch_q09/datafusion:vortex-compact 56866292 59276376 0.96
tpch_q10/datafusion:vortex-compact 44821119 46123902 0.97
tpch_q11/datafusion:vortex-compact 16896000 17303941 0.98
tpch_q12/datafusion:vortex-compact 30888919 31939227 0.97
tpch_q13/datafusion:vortex-compact 31807801 32102927 0.99
tpch_q14/datafusion:vortex-compact 19343221 19415098 1.00
tpch_q15/datafusion:vortex-compact 30739096 31792388 0.97
tpch_q16/datafusion:vortex-compact 23414789 24905303 0.94
tpch_q17/datafusion:vortex-compact 69891814 70450656 0.99
tpch_q18/datafusion:vortex-compact 81543744 86801040 0.94
tpch_q19/datafusion:vortex-compact 30107266 29988711 1.00
tpch_q20/datafusion:vortex-compact 33519493 34208361 0.98
tpch_q21/datafusion:vortex-compact 75121715 80122185 0.94
tpch_q22/datafusion:vortex-compact 12604462 13362725 0.94
datafusion / parquet (0.986x ➖, 1↑ 2↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 135921058 123250987 1.10
tpch_q02/datafusion:parquet 59504502 63075589 0.94
tpch_q03/datafusion:parquet 70936501 74683366 0.95
tpch_q04/datafusion:parquet 44446104 44676351 0.99
tpch_q05/datafusion:parquet 92314156 95314062 0.97
tpch_q06/datafusion:parquet 🚀 37473184 41680948 0.90
tpch_q07/datafusion:parquet 104827428 109368616 0.96
tpch_q08/datafusion:parquet 92031523 89762976 1.03
tpch_q09/datafusion:parquet 137259039 135400465 1.01
tpch_q10/datafusion:parquet 112500488 114575900 0.98
tpch_q11/datafusion:parquet 41736854 41752885 1.00
tpch_q12/datafusion:parquet 82816054 88126275 0.94
tpch_q13/datafusion:parquet 194239428 212037917 0.92
tpch_q14/datafusion:parquet 🚨 48563277 43898836 1.11
tpch_q15/datafusion:parquet 64443483 59029147 1.09
tpch_q16/datafusion:parquet 40144582 44084330 0.91
tpch_q17/datafusion:parquet 126755307 131957287 0.96
tpch_q18/datafusion:parquet 164696854 168756327 0.98
tpch_q19/datafusion:parquet 76347238 74868234 1.02
tpch_q20/datafusion:parquet 66265150 67174475 0.99
tpch_q21/datafusion:parquet 134895166 135076945 1.00
tpch_q22/datafusion:parquet 31657380 32463461 0.98
datafusion / arrow (0.974x ➖, 1↑ 0↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 54460352 52636845 1.03
tpch_q02/datafusion:arrow 19201643 19627359 0.98
tpch_q03/datafusion:arrow 33021521 30931182 1.07
tpch_q04/datafusion:arrow 27807066 26129905 1.06
tpch_q05/datafusion:arrow 83416920 76151012 1.10
tpch_q06/datafusion:arrow 21743438 20683476 1.05
tpch_q07/datafusion:arrow 106502062 105355346 1.01
tpch_q08/datafusion:arrow 41637306 45379165 0.92
tpch_q09/datafusion:arrow 62328606 67172376 0.93
tpch_q10/datafusion:arrow 🚀 45101691 51917247 0.87
tpch_q11/datafusion:arrow 8945741 9347058 0.96
tpch_q12/datafusion:arrow 51539472 52028296 0.99
tpch_q13/datafusion:arrow 46784497 47627694 0.98
tpch_q14/datafusion:arrow 21801612 22105919 0.99
tpch_q15/datafusion:arrow 42210144 44964648 0.94
tpch_q16/datafusion:arrow 18437421 19230348 0.96
tpch_q17/datafusion:arrow 67584627 71260396 0.95
tpch_q18/datafusion:arrow 133040119 142713685 0.93
tpch_q19/datafusion:arrow 34796389 38227554 0.91
tpch_q20/datafusion:arrow 33572899 35968958 0.93
tpch_q21/datafusion:arrow 147109396 155203399 0.95
tpch_q22/datafusion:arrow 17223227 18046160 0.95
duckdb / vortex-file-compressed (0.986x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 31666796 31720146 1.00
tpch_q02/duckdb:vortex-file-compressed 25290453 23725054 1.07
tpch_q03/duckdb:vortex-file-compressed 29252000 30577077 0.96
tpch_q04/duckdb:vortex-file-compressed 27967953 28779188 0.97
tpch_q05/duckdb:vortex-file-compressed 36281652 37292489 0.97
tpch_q06/duckdb:vortex-file-compressed 8703380 8131479 1.07
tpch_q07/duckdb:vortex-file-compressed 33489495 33022961 1.01
tpch_q08/duckdb:vortex-file-compressed 36384285 35568707 1.02
tpch_q09/duckdb:vortex-file-compressed 58423181 60233148 0.97
tpch_q10/duckdb:vortex-file-compressed 40647797 42031847 0.97
tpch_q11/duckdb:vortex-file-compressed 14372158 14895083 0.96
tpch_q12/duckdb:vortex-file-compressed 21116747 21825296 0.97
tpch_q13/duckdb:vortex-file-compressed 35365059 35875419 0.99
tpch_q14/duckdb:vortex-file-compressed 20153958 20376233 0.99
tpch_q15/duckdb:vortex-file-compressed 16480081 16753679 0.98
tpch_q16/duckdb:vortex-file-compressed 25585708 26283483 0.97
tpch_q17/duckdb:vortex-file-compressed 24478588 23891007 1.02
tpch_q18/duckdb:vortex-file-compressed 51927550 50919667 1.02
tpch_q19/duckdb:vortex-file-compressed 28706050 30482735 0.94
tpch_q20/duckdb:vortex-file-compressed 31868029 32651703 0.98
tpch_q21/duckdb:vortex-file-compressed 93700811 100686545 0.93
tpch_q22/duckdb:vortex-file-compressed 14805796 15915067 0.93
duckdb / vortex-compact (0.975x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 37730619 38625195 0.98
tpch_q02/duckdb:vortex-compact 30882560 31560725 0.98
tpch_q03/duckdb:vortex-compact 31812072 32421353 0.98
tpch_q04/duckdb:vortex-compact 28977801 30318568 0.96
tpch_q05/duckdb:vortex-compact 39695780 41716430 0.95
tpch_q06/duckdb:vortex-compact 10436060 10876318 0.96
tpch_q07/duckdb:vortex-compact 39472224 39812709 0.99
tpch_q08/duckdb:vortex-compact 38631614 40881441 0.94
tpch_q09/duckdb:vortex-compact 66058355 67194995 0.98
tpch_q10/duckdb:vortex-compact 46327938 46707148 0.99
tpch_q11/duckdb:vortex-compact 16742845 18195441 0.92
tpch_q12/duckdb:vortex-compact 27763172 28648569 0.97
tpch_q13/duckdb:vortex-compact 42273163 43065631 0.98
tpch_q14/duckdb:vortex-compact 25411381 25839489 0.98
tpch_q15/duckdb:vortex-compact 19841416 20019837 0.99
tpch_q16/duckdb:vortex-compact 31416886 31461855 1.00
tpch_q17/duckdb:vortex-compact 30098561 28789744 1.05
tpch_q18/duckdb:vortex-compact 49366446 51141850 0.97
tpch_q19/duckdb:vortex-compact 32610719 35012369 0.93
tpch_q20/duckdb:vortex-compact 38954035 39245411 0.99
tpch_q21/duckdb:vortex-compact 97557385 101016960 0.97
tpch_q22/duckdb:vortex-compact 17766999 17757423 1.00
duckdb / parquet (0.989x ➖, 2↑ 1↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 78924738 81452249 0.97
tpch_q02/duckdb:parquet 37871690 39326075 0.96
tpch_q03/duckdb:parquet 67391948 69589266 0.97
tpch_q04/duckdb:parquet 47008291 48170922 0.98
tpch_q05/duckdb:parquet 64816582 67073199 0.97
tpch_q06/duckdb:parquet 20516857 20616848 1.00
tpch_q07/duckdb:parquet 72359121 69493756 1.04
tpch_q08/duckdb:parquet 🚨 93633796 81988164 1.14
tpch_q09/duckdb:parquet 🚀 131788409 159344756 0.83
tpch_q10/duckdb:parquet 130161965 127193145 1.02
tpch_q11/duckdb:parquet 22268651 21524793 1.03
tpch_q12/duckdb:parquet 47201967 46091550 1.02
tpch_q13/duckdb:parquet 248571343 262147934 0.95
tpch_q14/duckdb:parquet 48760871 48520122 1.00
tpch_q15/duckdb:parquet 🚀 24706103 27615564 0.89
tpch_q16/duckdb:parquet 56316640 57644013 0.98
tpch_q17/duckdb:parquet 54222564 54159135 1.00
tpch_q18/duckdb:parquet 114254189 113569409 1.01
tpch_q19/duckdb:parquet 67365987 70302055 0.96
tpch_q20/duckdb:parquet 67593985 63797630 1.06
tpch_q21/duckdb:parquet 165402610 165040196 1.00
tpch_q22/duckdb:parquet 53456181 53006866 1.01
duckdb / duckdb (0.972x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base faf7e42 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15925226 16078780 0.99
tpch_q02/duckdb:duckdb 12431051 13100846 0.95
tpch_q03/duckdb:duckdb 19064499 19421347 0.98
tpch_q04/duckdb:duckdb 19246361 20097809 0.96
tpch_q05/duckdb:duckdb 19522196 20105454 0.97
tpch_q06/duckdb:duckdb 5242706 5421421 0.97
tpch_q07/duckdb:duckdb 21285099 22913645 0.93
tpch_q08/duckdb:duckdb 21480776 21630890 0.99
tpch_q09/duckdb:duckdb 58342824 57221425 1.02
tpch_q10/duckdb:duckdb 43929417 44295266 0.99
tpch_q11/duckdb:duckdb 5774984 6041332 0.96
tpch_q12/duckdb:duckdb 13876087 13981473 0.99
tpch_q13/duckdb:duckdb 37829839 39595511 0.96
tpch_q14/duckdb:duckdb 17401179 18869381 0.92
tpch_q15/duckdb:duckdb 12034698 12710663 0.95
tpch_q16/duckdb:duckdb 23284798 24100742 0.97
tpch_q17/duckdb:duckdb 14889748 13938301 1.07
tpch_q18/duckdb:duckdb 39794714 38973249 1.02
tpch_q19/duckdb:duckdb 25940912 28593060 0.91
tpch_q20/duckdb:duckdb 22427423 22860672 0.98
tpch_q21/duckdb:duckdb 55713590 58687598 0.95
tpch_q22/duckdb:duckdb 24245279 24558881 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow +3.5% +3.4% +0.1% +21.7% ➖ noise
1 datafusion:vortex-compact +0.7% +3.4% -2.6% +18.6% ➖ noise
1 datafusion:vortex-file-compressed -7.3% +3.4% -10.4% +20.5% ➖ noise
1 duckdb:duckdb -1.0% +3.4% -4.2% +18.6% ➖ noise
1 duckdb:vortex-compact -2.3% +3.4% -5.5% +18.4% ➖ noise
1 duckdb:vortex-file-compressed -0.2% +3.4% -3.4% +21.7% ➖ noise
2 datafusion:arrow -2.2% -4.7% +2.6% +10.8% ➖ noise
2 datafusion:vortex-compact -0.5% -4.7% +4.4% +10.8% ➖ noise
2 datafusion:vortex-file-compressed -3.7% -4.7% +1.0% +10.8% ➖ noise
2 duckdb:duckdb -5.1% -4.7% -0.4% +12.8% ➖ noise
2 duckdb:vortex-compact -2.1% -4.7% +2.7% +10.8% ➖ noise
2 duckdb:vortex-file-compressed +6.6% -4.7% +11.8% +10.8% 🚨 regression
3 datafusion:arrow +6.8% -4.1% +11.3% +10.8% 🚨 regression
3 datafusion:vortex-compact -2.9% -4.1% +1.3% +10.8% ➖ noise
3 datafusion:vortex-file-compressed -5.8% -4.1% -1.8% +10.8% ➖ noise
3 duckdb:duckdb -1.8% -4.1% +2.4% +12.2% ➖ noise
3 duckdb:vortex-compact -1.9% -4.1% +2.3% +10.8% ➖ noise
3 duckdb:vortex-file-compressed -4.3% -4.1% -0.3% +13.0% ➖ noise
4 datafusion:arrow +6.4% -1.5% +8.0% +10.8% ➖ noise
4 datafusion:vortex-compact -3.5% -1.5% -2.0% +10.8% ➖ noise
4 datafusion:vortex-file-compressed -0.6% -1.5% +0.9% +10.8% ➖ noise
4 duckdb:duckdb -4.2% -1.5% -2.8% +10.8% ➖ noise
4 duckdb:vortex-compact -4.4% -1.5% -3.0% +10.8% ➖ noise
4 duckdb:vortex-file-compressed -2.8% -1.5% -1.4% +10.8% ➖ noise
5 datafusion:arrow +9.5% -3.3% +13.2% +16.1% ➖ noise
5 datafusion:vortex-compact -4.1% -3.3% -0.9% +10.8% ➖ noise
5 datafusion:vortex-file-compressed -4.7% -3.3% -1.5% +10.8% ➖ noise
5 duckdb:duckdb -2.9% -3.3% +0.4% +10.8% ➖ noise
5 duckdb:vortex-compact -4.8% -3.3% -1.6% +10.8% ➖ noise
5 duckdb:vortex-file-compressed -2.7% -3.3% +0.6% +10.8% ➖ noise
6 datafusion:arrow +5.1% -5.4% +11.1% +18.1% ➖ noise
6 datafusion:vortex-compact -4.8% -5.4% +0.7% +15.7% ➖ noise
6 datafusion:vortex-file-compressed -6.7% -5.4% -1.4% +16.5% ➖ noise
6 duckdb:duckdb -3.3% -5.4% +2.2% +17.7% ➖ noise
6 duckdb:vortex-compact -4.0% -5.4% +1.4% +25.4% ➖ noise
6 duckdb:vortex-file-compressed +7.0% -5.4% +13.2% +17.1% ➖ noise
7 datafusion:arrow +1.1% -0.1% +1.2% +10.8% ➖ noise
7 datafusion:vortex-compact -0.8% -0.1% -0.7% +10.8% ➖ noise
7 datafusion:vortex-file-compressed +0.4% -0.1% +0.5% +10.8% ➖ noise
7 duckdb:duckdb -7.1% -0.1% -7.0% +10.8% ➖ noise
7 duckdb:vortex-compact -0.9% -0.1% -0.8% +10.8% ➖ noise
7 duckdb:vortex-file-compressed +1.4% -0.1% +1.5% +10.8% ➖ noise
8 datafusion:arrow -8.2% +8.2% -15.2% +10.8% ✅ faster
8 datafusion:vortex-compact -3.4% +8.2% -10.7% +10.8% ✅ faster
8 datafusion:vortex-file-compressed -3.1% +8.2% -10.5% +10.8% ✅ faster
8 duckdb:duckdb -0.7% +8.2% -8.2% +10.8% ➖ noise
8 duckdb:vortex-compact -5.5% +8.2% -12.7% +10.8% ✅ faster
8 duckdb:vortex-file-compressed +2.3% +8.2% -5.5% +11.7% ➖ noise
9 datafusion:arrow -7.2% -8.4% +1.3% +10.8% ➖ noise
9 datafusion:vortex-compact -4.1% -8.4% +4.8% +10.8% ➖ noise
9 datafusion:vortex-file-compressed -0.3% -8.4% +8.9% +10.8% ➖ noise
9 duckdb:duckdb +2.0% -8.4% +11.4% +10.8% 🚨 regression
9 duckdb:vortex-compact -1.7% -8.4% +7.4% +10.8% ➖ noise
9 duckdb:vortex-file-compressed -3.0% -8.4% +5.9% +10.8% ➖ noise
10 datafusion:arrow -13.1% +0.2% -13.3% +10.8% ✅ faster
10 datafusion:vortex-compact -2.8% +0.2% -3.1% +10.8% ➖ noise
10 datafusion:vortex-file-compressed -1.4% +0.2% -1.7% +10.8% ➖ noise
10 duckdb:duckdb -0.8% +0.2% -1.1% +11.2% ➖ noise
10 duckdb:vortex-compact -0.8% +0.2% -1.0% +10.8% ➖ noise
10 duckdb:vortex-file-compressed -3.3% +0.2% -3.5% +10.8% ➖ noise
11 datafusion:arrow -4.3% +1.7% -5.9% +10.8% ➖ noise
11 datafusion:vortex-compact -2.4% +1.7% -4.0% +10.8% ➖ noise
11 datafusion:vortex-file-compressed -5.2% +1.7% -6.8% +10.8% ➖ noise
11 duckdb:duckdb -4.4% +1.7% -6.0% +10.8% ➖ noise
11 duckdb:vortex-compact -8.0% +1.7% -9.5% +14.3% ➖ noise
11 duckdb:vortex-file-compressed -3.5% +1.7% -5.1% +13.8% ➖ noise
12 datafusion:arrow -0.9% -1.9% +1.0% +18.3% ➖ noise
12 datafusion:vortex-compact -3.3% -1.9% -1.4% +11.5% ➖ noise
12 datafusion:vortex-file-compressed +0.5% -1.9% +2.4% +10.8% ➖ noise
12 duckdb:duckdb -0.8% -1.9% +1.2% +11.6% ➖ noise
12 duckdb:vortex-compact -3.1% -1.9% -1.2% +10.8% ➖ noise
12 duckdb:vortex-file-compressed -3.2% -1.9% -1.4% +13.5% ➖ noise
13 datafusion:arrow -1.8% -6.8% +5.4% +10.8% ➖ noise
13 datafusion:vortex-compact -0.9% -6.8% +6.3% +10.8% ➖ noise
13 datafusion:vortex-file-compressed -3.2% -6.8% +3.9% +10.8% ➖ noise
13 duckdb:duckdb -4.5% -6.8% +2.5% +10.8% ➖ noise
13 duckdb:vortex-compact -1.8% -6.8% +5.3% +10.8% ➖ noise
13 duckdb:vortex-file-compressed -1.4% -6.8% +5.8% +10.8% ➖ noise
14 datafusion:arrow -1.4% +5.4% -6.5% +11.2% ➖ noise
14 datafusion:vortex-compact -0.4% +5.4% -5.5% +12.2% ➖ noise
14 datafusion:vortex-file-compressed -3.5% +5.4% -8.5% +10.8% ➖ noise
14 duckdb:duckdb -7.8% +5.4% -12.5% +19.2% ➖ noise
14 duckdb:vortex-compact -1.7% +5.4% -6.7% +10.8% ➖ noise
14 duckdb:vortex-file-compressed -1.1% +5.4% -6.2% +15.7% ➖ noise
15 datafusion:arrow -6.1% -1.2% -5.0% +12.4% ➖ noise
15 datafusion:vortex-compact -3.3% -1.2% -2.2% +14.0% ➖ noise
15 datafusion:vortex-file-compressed -0.5% -1.2% +0.6% +12.4% ➖ noise
15 duckdb:duckdb -5.3% -1.2% -4.2% +23.9% ➖ noise
15 duckdb:vortex-compact -0.9% -1.2% +0.3% +14.8% ➖ noise
15 duckdb:vortex-file-compressed -1.6% -1.2% -0.5% +13.3% ➖ noise
16 datafusion:arrow -4.1% -5.7% +1.6% +10.8% ➖ noise
16 datafusion:vortex-compact -6.0% -5.7% -0.3% +10.8% ➖ noise
16 datafusion:vortex-file-compressed -2.0% -5.7% +3.9% +10.8% ➖ noise
16 duckdb:duckdb -3.4% -5.7% +2.4% +10.8% ➖ noise
16 duckdb:vortex-compact -0.1% -5.7% +5.9% +10.8% ➖ noise
16 duckdb:vortex-file-compressed -2.7% -5.7% +3.2% +10.8% ➖ noise
17 datafusion:arrow -5.2% -1.9% -3.3% +10.8% ➖ noise
17 datafusion:vortex-compact -0.8% -1.9% +1.2% +10.8% ➖ noise
17 datafusion:vortex-file-compressed -4.6% -1.9% -2.7% +10.8% ➖ noise
17 duckdb:duckdb +6.8% -1.9% +8.9% +11.3% ➖ noise
17 duckdb:vortex-compact +4.5% -1.9% +6.6% +11.3% ➖ noise
17 duckdb:vortex-file-compressed +2.5% -1.9% +4.5% +15.4% ➖ noise
18 datafusion:arrow -6.8% -0.9% -5.9% +10.8% ➖ noise
18 datafusion:vortex-compact -6.1% -0.9% -5.2% +10.8% ➖ noise
18 datafusion:vortex-file-compressed -5.5% -0.9% -4.7% +10.8% ➖ noise
18 duckdb:duckdb +2.1% -0.9% +3.0% +10.8% ➖ noise
18 duckdb:vortex-compact -3.5% -0.9% -2.6% +10.8% ➖ noise
18 duckdb:vortex-file-compressed +2.0% -0.9% +2.9% +10.8% ➖ noise
19 datafusion:arrow -9.0% -1.1% -7.9% +16.1% ➖ noise
19 datafusion:vortex-compact +0.4% -1.1% +1.6% +11.0% ➖ noise
19 datafusion:vortex-file-compressed -5.7% -1.1% -4.6% +11.0% ➖ noise
19 duckdb:duckdb -9.3% -1.1% -8.2% +13.9% ➖ noise
19 duckdb:vortex-compact -6.9% -1.1% -5.8% +11.5% ➖ noise
19 duckdb:vortex-file-compressed -5.8% -1.1% -4.7% +12.6% ➖ noise
20 datafusion:arrow -6.7% +2.2% -8.7% +10.8% ➖ noise
20 datafusion:vortex-compact -2.0% +2.2% -4.2% +10.8% ➖ noise
20 datafusion:vortex-file-compressed -4.2% +2.2% -6.3% +10.8% ➖ noise
20 duckdb:duckdb -1.9% +2.2% -4.0% +10.8% ➖ noise
20 duckdb:vortex-compact -0.7% +2.2% -2.9% +10.8% ➖ noise
20 duckdb:vortex-file-compressed -2.4% +2.2% -4.5% +10.8% ➖ noise
21 datafusion:arrow -5.2% +0.0% -5.3% +10.8% ➖ noise
21 datafusion:vortex-compact -6.2% +0.0% -6.3% +10.8% ➖ noise
21 datafusion:vortex-file-compressed -3.7% +0.0% -3.7% +10.8% ➖ noise
21 duckdb:duckdb -5.1% +0.0% -5.1% +10.8% ➖ noise
21 duckdb:vortex-compact -3.4% +0.0% -3.5% +10.8% ➖ noise
21 duckdb:vortex-file-compressed -6.9% +0.0% -7.0% +10.8% ➖ noise
22 datafusion:arrow -4.6% -0.8% -3.8% +10.8% ➖ noise
22 datafusion:vortex-compact -5.7% -0.8% -4.9% +10.8% ➖ noise
22 datafusion:vortex-file-compressed +0.4% -0.8% +1.2% +10.8% ➖ noise
22 duckdb:duckdb -1.3% -0.8% -0.4% +10.8% ➖ noise
22 duckdb:vortex-compact +0.1% -0.8% +0.9% +10.8% ➖ noise
22 duckdb:vortex-file-compressed -7.0% -0.8% -6.2% +10.8% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +4.0%
Vortex (geomean): 1.005x ➖
Parquet (geomean): 0.994x ➖
Shifts: Parquet (control) -0.6% · Median polish +0.4%

datafusion / vortex-file-compressed (1.000x ➖, 1↑ 3↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 24903723 24902780 1.00
tpcds_q02/datafusion:vortex-file-compressed 47059687 46606154 1.01
tpcds_q03/datafusion:vortex-file-compressed 15684444 14888950 1.05
tpcds_q04/datafusion:vortex-file-compressed 255595408 248898520 1.03
tpcds_q05/datafusion:vortex-file-compressed 42901796 42868990 1.00
tpcds_q06/datafusion:vortex-file-compressed 59862806 58511605 1.02
tpcds_q07/datafusion:vortex-file-compressed 42454272 41000976 1.04
tpcds_q08/datafusion:vortex-file-compressed 29358154 28988202 1.01
tpcds_q09/datafusion:vortex-file-compressed 39105316 39890410 0.98
tpcds_q10/datafusion:vortex-file-compressed 37809823 37253823 1.01
tpcds_q11/datafusion:vortex-file-compressed 127653716 124735709 1.02
tpcds_q12/datafusion:vortex-file-compressed 18245147 20233138 0.90
tpcds_q13/datafusion:vortex-file-compressed 39304396 39967710 0.98
tpcds_q14/datafusion:vortex-file-compressed 170116435 169917469 1.00
tpcds_q15/datafusion:vortex-file-compressed 28190585 28340923 0.99
tpcds_q16/datafusion:vortex-file-compressed 27653402 28163510 0.98
tpcds_q17/datafusion:vortex-file-compressed 62301317 60612004 1.03
tpcds_q18/datafusion:vortex-file-compressed 68511720 68800868 1.00
tpcds_q19/datafusion:vortex-file-compressed 21405235 21818789 0.98
tpcds_q20/datafusion:vortex-file-compressed 20861837 21836736 0.96
tpcds_q21/datafusion:vortex-file-compressed 35076064 35635011 0.98
tpcds_q22/datafusion:vortex-file-compressed 🚀 115097933 150822304 0.76
tpcds_q23/datafusion:vortex-file-compressed 145705450 150787517 0.97
tpcds_q24/datafusion:vortex-file-compressed 81954854 84385291 0.97
tpcds_q25/datafusion:vortex-file-compressed 64639723 64185242 1.01
tpcds_q26/datafusion:vortex-file-compressed 33278316 32639289 1.02
tpcds_q27/datafusion:vortex-file-compressed 100437510 100188990 1.00
tpcds_q28/datafusion:vortex-file-compressed 34370082 33414143 1.03
tpcds_q29/datafusion:vortex-file-compressed 61511514 59651302 1.03
tpcds_q30/datafusion:vortex-file-compressed 24833421 22841724 1.09
tpcds_q31/datafusion:vortex-file-compressed 72314496 73504472 0.98
tpcds_q32/datafusion:vortex-file-compressed 19843060 19600481 1.01
tpcds_q33/datafusion:vortex-file-compressed 29182514 29682896 0.98
tpcds_q34/datafusion:vortex-file-compressed 24718361 24335812 1.02
tpcds_q35/datafusion:vortex-file-compressed 46009123 45832095 1.00
tpcds_q36/datafusion:vortex-file-compressed 56916329 57630204 0.99
tpcds_q37/datafusion:vortex-file-compressed 23207268 24116318 0.96
tpcds_q38/datafusion:vortex-file-compressed 41617473 41766388 1.00
tpcds_q39/datafusion:vortex-file-compressed 104129010 104631756 1.00
tpcds_q40/datafusion:vortex-file-compressed 32480944 31790930 1.02
tpcds_q41/datafusion:vortex-file-compressed 14810324 14792724 1.00
tpcds_q42/datafusion:vortex-file-compressed 13907831 13521233 1.03
tpcds_q43/datafusion:vortex-file-compressed 18517368 18728729 0.99
tpcds_q44/datafusion:vortex-file-compressed 32103341 31069634 1.03
tpcds_q45/datafusion:vortex-file-compressed 27225432 27271065 1.00
tpcds_q46/datafusion:vortex-file-compressed 35109132 33528044 1.05
tpcds_q47/datafusion:vortex-file-compressed 129772581 129517001 1.00
tpcds_q48/datafusion:vortex-file-compressed 36347242 35404861 1.03
tpcds_q49/datafusion:vortex-file-compressed 59064222 57053629 1.04
tpcds_q50/datafusion:vortex-file-compressed 39207612 38999992 1.01
tpcds_q51/datafusion:vortex-file-compressed 86566818 86743927 1.00
tpcds_q52/datafusion:vortex-file-compressed 🚨 16340931 14415804 1.13
tpcds_q53/datafusion:vortex-file-compressed 20719030 21550199 0.96
tpcds_q54/datafusion:vortex-file-compressed 35126589 34659803 1.01
tpcds_q55/datafusion:vortex-file-compressed 13572579 14351645 0.95
tpcds_q56/datafusion:vortex-file-compressed 30498653 29514686 1.03
tpcds_q57/datafusion:vortex-file-compressed 106781799 106815973 1.00
tpcds_q58/datafusion:vortex-file-compressed 51923204 52934584 0.98
tpcds_q59/datafusion:vortex-file-compressed 55713918 56828325 0.98
tpcds_q60/datafusion:vortex-file-compressed 29667111 29491135 1.01
tpcds_q61/datafusion:vortex-file-compressed 40638661 40121910 1.01
tpcds_q62/datafusion:vortex-file-compressed 26767936 26530383 1.01
tpcds_q63/datafusion:vortex-file-compressed 21512652 21615278 1.00
tpcds_q64/datafusion:vortex-file-compressed 414910753 412781042 1.01
tpcds_q65/datafusion:vortex-file-compressed 39416762 39140490 1.01
tpcds_q66/datafusion:vortex-file-compressed 70506476 73336677 0.96
tpcds_q67/datafusion:vortex-file-compressed 146084378 146583369 1.00
tpcds_q68/datafusion:vortex-file-compressed 32270067 32390468 1.00
tpcds_q69/datafusion:vortex-file-compressed 35758535 36249954 0.99
tpcds_q70/datafusion:vortex-file-compressed 86789712 85888166 1.01
tpcds_q71/datafusion:vortex-file-compressed 22164079 23213011 0.95
tpcds_q72/datafusion:vortex-file-compressed 2132235308 2132880144 1.00
tpcds_q73/datafusion:vortex-file-compressed 23171117 22409407 1.03
tpcds_q74/datafusion:vortex-file-compressed 79773249 80556211 0.99
tpcds_q75/datafusion:vortex-file-compressed 109565887 107304380 1.02
tpcds_q76/datafusion:vortex-file-compressed 23126131 23494598 0.98
tpcds_q77/datafusion:vortex-file-compressed 38303897 39244435 0.98
tpcds_q78/datafusion:vortex-file-compressed 124776977 127154651 0.98
tpcds_q79/datafusion:vortex-file-compressed 27647749 28240168 0.98
tpcds_q80/datafusion:vortex-file-compressed 91047781 93876339 0.97
tpcds_q81/datafusion:vortex-file-compressed 🚨 26155141 23306868 1.12
tpcds_q82/datafusion:vortex-file-compressed 25952912 25368423 1.02
tpcds_q83/datafusion:vortex-file-compressed 33321337 35562825 0.94
tpcds_q84/datafusion:vortex-file-compressed 12508667 12744246 0.98
tpcds_q85/datafusion:vortex-file-compressed 89247928 91896141 0.97
tpcds_q86/datafusion:vortex-file-compressed 15691096 16121969 0.97
tpcds_q87/datafusion:vortex-file-compressed 43721257 43329361 1.01
tpcds_q88/datafusion:vortex-file-compressed 54807768 55989225 0.98
tpcds_q89/datafusion:vortex-file-compressed 24182990 24797039 0.98
tpcds_q90/datafusion:vortex-file-compressed 14411703 14151994 1.02
tpcds_q91/datafusion:vortex-file-compressed 17523704 18125157 0.97
tpcds_q92/datafusion:vortex-file-compressed 17701415 17800367 0.99
tpcds_q93/datafusion:vortex-file-compressed 33640064 32595726 1.03
tpcds_q94/datafusion:vortex-file-compressed 23512794 23097071 1.02
tpcds_q95/datafusion:vortex-file-compressed 60779311 62076641 0.98
tpcds_q96/datafusion:vortex-file-compressed 13379833 13379134 1.00
tpcds_q97/datafusion:vortex-file-compressed 32995548 31200016 1.06
tpcds_q98/datafusion:vortex-file-compressed 23565059 23835331 0.99
tpcds_q99/datafusion:vortex-file-compressed 🚨 32054610 27670893 1.16
datafusion / vortex-compact (1.007x ➖, 1↑ 2↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 24828406 25515689 0.97
tpcds_q02/datafusion:vortex-compact 53706335 54844261 0.98
tpcds_q03/datafusion:vortex-compact 19165789 19073675 1.00
tpcds_q04/datafusion:vortex-compact 297061525 288237848 1.03
tpcds_q05/datafusion:vortex-compact 47584014 49372758 0.96
tpcds_q06/datafusion:vortex-compact 61617324 59932486 1.03
tpcds_q07/datafusion:vortex-compact 52192464 54512682 0.96
tpcds_q08/datafusion:vortex-compact 35391439 35738285 0.99
tpcds_q09/datafusion:vortex-compact 51499305 54029916 0.95
tpcds_q10/datafusion:vortex-compact 48641487 48632824 1.00
tpcds_q11/datafusion:vortex-compact 148139526 154717954 0.96
tpcds_q12/datafusion:vortex-compact 23692291 25505227 0.93
tpcds_q13/datafusion:vortex-compact 🚨 150077249 123445261 1.22
tpcds_q14/datafusion:vortex-compact 197751900 192389874 1.03
tpcds_q15/datafusion:vortex-compact 30518607 31142089 0.98
tpcds_q16/datafusion:vortex-compact 31756003 32610328 0.97
tpcds_q17/datafusion:vortex-compact 72399860 72282044 1.00
tpcds_q18/datafusion:vortex-compact 79213884 78646835 1.01
tpcds_q19/datafusion:vortex-compact 29189180 29211855 1.00
tpcds_q20/datafusion:vortex-compact 25666916 26516046 0.97
tpcds_q21/datafusion:vortex-compact 39525577 38457222 1.03
tpcds_q22/datafusion:vortex-compact 🚀 115141919 128297193 0.90
tpcds_q23/datafusion:vortex-compact 167946566 166290848 1.01
tpcds_q24/datafusion:vortex-compact 94971852 98320804 0.97
tpcds_q25/datafusion:vortex-compact 77592688 77282476 1.00
tpcds_q26/datafusion:vortex-compact 45082351 44336486 1.02
tpcds_q27/datafusion:vortex-compact 123629021 119730600 1.03
tpcds_q28/datafusion:vortex-compact 99677438 100516708 0.99
tpcds_q29/datafusion:vortex-compact 74002457 71577455 1.03
tpcds_q30/datafusion:vortex-compact 28056041 26599577 1.05
tpcds_q31/datafusion:vortex-compact 98261382 99738282 0.99
tpcds_q32/datafusion:vortex-compact 25055184 25324499 0.99
tpcds_q33/datafusion:vortex-compact 36154052 36703764 0.99
tpcds_q34/datafusion:vortex-compact 33003493 32483067 1.02
tpcds_q35/datafusion:vortex-compact 51121095 52977379 0.96
tpcds_q36/datafusion:vortex-compact 73192782 73351541 1.00
tpcds_q37/datafusion:vortex-compact 33461903 34133165 0.98
tpcds_q38/datafusion:vortex-compact 53730939 50465616 1.06
tpcds_q39/datafusion:vortex-compact 107832346 113394532 0.95
tpcds_q40/datafusion:vortex-compact 36079536 35973621 1.00
tpcds_q41/datafusion:vortex-compact 16894925 16870602 1.00
tpcds_q42/datafusion:vortex-compact 17889418 17815929 1.00
tpcds_q43/datafusion:vortex-compact 25843588 24938565 1.04
tpcds_q44/datafusion:vortex-compact 48692943 48893308 1.00
tpcds_q45/datafusion:vortex-compact 31559534 32514407 0.97
tpcds_q46/datafusion:vortex-compact 43240501 44359063 0.97
tpcds_q47/datafusion:vortex-compact 148780398 147913594 1.01
tpcds_q48/datafusion:vortex-compact 82690583 80203577 1.03
tpcds_q49/datafusion:vortex-compact 70388365 68467681 1.03
tpcds_q50/datafusion:vortex-compact 47437033 46484448 1.02
tpcds_q51/datafusion:vortex-compact 91676504 95948502 0.96
tpcds_q52/datafusion:vortex-compact 18619453 18441478 1.01
tpcds_q53/datafusion:vortex-compact 27474768 28496569 0.96
tpcds_q54/datafusion:vortex-compact 42080944 43362805 0.97
tpcds_q55/datafusion:vortex-compact 18525544 17783338 1.04
tpcds_q56/datafusion:vortex-compact 35845809 35227766 1.02
tpcds_q57/datafusion:vortex-compact 117475623 116694714 1.01
tpcds_q58/datafusion:vortex-compact 59435898 65183897 0.91
tpcds_q59/datafusion:vortex-compact 71174512 68940291 1.03
tpcds_q60/datafusion:vortex-compact 36918337 34723982 1.06
tpcds_q61/datafusion:vortex-compact 54368040 53844853 1.01
tpcds_q62/datafusion:vortex-compact 🚨 27121793 24357537 1.11
tpcds_q63/datafusion:vortex-compact 27611821 28027931 0.99
tpcds_q64/datafusion:vortex-compact 445322692 447426684 1.00
tpcds_q65/datafusion:vortex-compact 54331405 52815821 1.03
tpcds_q66/datafusion:vortex-compact 76581713 75233470 1.02
tpcds_q67/datafusion:vortex-compact 157619101 155094149 1.02
tpcds_q68/datafusion:vortex-compact 43814810 44145247 0.99
tpcds_q69/datafusion:vortex-compact 46147958 46534790 0.99
tpcds_q70/datafusion:vortex-compact 95553310 98862584 0.97
tpcds_q71/datafusion:vortex-compact 29616452 29510793 1.00
tpcds_q72/datafusion:vortex-compact 2198333551 2111306967 1.04
tpcds_q73/datafusion:vortex-compact 31304850 29891232 1.05
tpcds_q74/datafusion:vortex-compact 92074290 92587069 0.99
tpcds_q75/datafusion:vortex-compact 127719029 125713612 1.02
tpcds_q76/datafusion:vortex-compact 33343476 32159711 1.04
tpcds_q77/datafusion:vortex-compact 52216596 49307108 1.06
tpcds_q78/datafusion:vortex-compact 148884679 137379979 1.08
tpcds_q79/datafusion:vortex-compact 38303624 37557252 1.02
tpcds_q80/datafusion:vortex-compact 104780796 104842438 1.00
tpcds_q81/datafusion:vortex-compact 29009928 27696087 1.05
tpcds_q82/datafusion:vortex-compact 34749013 33821341 1.03
tpcds_q83/datafusion:vortex-compact 33493297 32338689 1.04
tpcds_q84/datafusion:vortex-compact 14500240 14241003 1.02
tpcds_q85/datafusion:vortex-compact 153719478 148185340 1.04
tpcds_q86/datafusion:vortex-compact 18316322 18462420 0.99
tpcds_q87/datafusion:vortex-compact 50954962 49068112 1.04
tpcds_q88/datafusion:vortex-compact 75452582 75632721 1.00
tpcds_q89/datafusion:vortex-compact 31569422 30650149 1.03
tpcds_q90/datafusion:vortex-compact 15185494 14706531 1.03
tpcds_q91/datafusion:vortex-compact 32528692 31994232 1.02
tpcds_q92/datafusion:vortex-compact 25961470 23830118 1.09
tpcds_q93/datafusion:vortex-compact 37685735 37055343 1.02
tpcds_q94/datafusion:vortex-compact 28011229 27375973 1.02
tpcds_q95/datafusion:vortex-compact 67181753 64547743 1.04
tpcds_q96/datafusion:vortex-compact 17091572 17175464 1.00
tpcds_q97/datafusion:vortex-compact 35245731 35713403 0.99
tpcds_q98/datafusion:vortex-compact 30178316 29728014 1.02
tpcds_q99/datafusion:vortex-compact 29651774 30228292 0.98
datafusion / parquet (0.993x ➖, 2↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 28929889 30449925 0.95
tpcds_q02/datafusion:parquet 41542513 42195725 0.98
tpcds_q03/datafusion:parquet 12869048 12839605 1.00
tpcds_q04/datafusion:parquet 262291439 272753390 0.96
tpcds_q05/datafusion:parquet 40053656 41233494 0.97
tpcds_q06/datafusion:parquet 57737313 58941414 0.98
tpcds_q07/datafusion:parquet 78638983 74799591 1.05
tpcds_q08/datafusion:parquet 25936223 25737183 1.01
tpcds_q09/datafusion:parquet 43436855 43128252 1.01
tpcds_q10/datafusion:parquet 68083778 67626244 1.01
tpcds_q11/datafusion:parquet 147956476 142555463 1.04
tpcds_q12/datafusion:parquet 18006513 17786186 1.01
tpcds_q13/datafusion:parquet 74372584 73990462 1.01
tpcds_q14/datafusion:parquet 157260376 161075697 0.98
tpcds_q15/datafusion:parquet 20494519 21921003 0.93
tpcds_q16/datafusion:parquet 🚀 22131742 24623199 0.90
tpcds_q17/datafusion:parquet 62777404 63308007 0.99
tpcds_q18/datafusion:parquet 112448684 113141219 0.99
tpcds_q19/datafusion:parquet 21768156 21765999 1.00
tpcds_q20/datafusion:parquet 16019239 16188574 0.99
tpcds_q21/datafusion:parquet 18034375 17992010 1.00
tpcds_q22/datafusion:parquet 146860642 147631658 0.99
tpcds_q23/datafusion:parquet 145554209 141908446 1.03
tpcds_q24/datafusion:parquet 88120713 90353818 0.98
tpcds_q25/datafusion:parquet 63847351 63702216 1.00
tpcds_q26/datafusion:parquet 65014673 63111792 1.03
tpcds_q27/datafusion:parquet 140889969 143385301 0.98
tpcds_q28/datafusion:parquet 43186602 42754379 1.01
tpcds_q29/datafusion:parquet 64346440 63978364 1.01
tpcds_q30/datafusion:parquet 34012616 33461630 1.02
tpcds_q31/datafusion:parquet 62247133 62916353 0.99
tpcds_q32/datafusion:parquet 17460248 17438349 1.00
tpcds_q33/datafusion:parquet 26874349 26159085 1.03
tpcds_q34/datafusion:parquet 20938736 20927246 1.00
tpcds_q35/datafusion:parquet 67287975 69545736 0.97
tpcds_q36/datafusion:parquet 55487407 56109318 0.99
tpcds_q37/datafusion:parquet 18813347 18551351 1.01
tpcds_q38/datafusion:parquet 40029676 40435846 0.99
tpcds_q39/datafusion:parquet 72884028 73421464 0.99
tpcds_q40/datafusion:parquet 23775051 23285792 1.02
tpcds_q41/datafusion:parquet 13251050 13311931 1.00
tpcds_q42/datafusion:parquet 11440060 11554879 0.99
tpcds_q43/datafusion:parquet 16797783 16974211 0.99
tpcds_q44/datafusion:parquet 31294043 31984973 0.98
tpcds_q45/datafusion:parquet 27317232 27525139 0.99
tpcds_q46/datafusion:parquet 30820604 33698705 0.91
tpcds_q47/datafusion:parquet 122121167 122041201 1.00
tpcds_q48/datafusion:parquet 67364330 69336176 0.97
tpcds_q49/datafusion:parquet 53829475 53188175 1.01
tpcds_q50/datafusion:parquet 42497802 42621291 1.00
tpcds_q51/datafusion:parquet 83450275 81474151 1.02
tpcds_q52/datafusion:parquet 11800769 11636633 1.01
tpcds_q53/datafusion:parquet 17483819 17689572 0.99
tpcds_q54/datafusion:parquet 34295624 32972409 1.04
tpcds_q55/datafusion:parquet 10866631 10933622 0.99
tpcds_q56/datafusion:parquet 26214185 26178276 1.00
tpcds_q57/datafusion:parquet 🚀 94197270 109997656 0.86
tpcds_q58/datafusion:parquet 49080192 48246355 1.02
tpcds_q59/datafusion:parquet 56504833 57193246 0.99
tpcds_q60/datafusion:parquet 26705068 26407607 1.01
tpcds_q61/datafusion:parquet 42410748 41703483 1.02
tpcds_q62/datafusion:parquet 25343119 23889839 1.06
tpcds_q63/datafusion:parquet 17182515 17698871 0.97
tpcds_q64/datafusion:parquet 500167523 505079304 0.99
tpcds_q65/datafusion:parquet 36664891 38056019 0.96
tpcds_q66/datafusion:parquet 68837145 68625845 1.00
tpcds_q67/datafusion:parquet 143656400 147386244 0.97
tpcds_q68/datafusion:parquet 31336813 31376122 1.00
tpcds_q69/datafusion:parquet 62994962 64525409 0.98
tpcds_q70/datafusion:parquet 84542182 82719006 1.02
tpcds_q71/datafusion:parquet 20992590 21576973 0.97
tpcds_q72/datafusion:parquet 586560909 584313366 1.00
tpcds_q73/datafusion:parquet 19779771 19664882 1.01
tpcds_q74/datafusion:parquet 78559921 79108744 0.99
tpcds_q75/datafusion:parquet 97710111 98753499 0.99
tpcds_q76/datafusion:parquet 29478511 29092921 1.01
tpcds_q77/datafusion:parquet 38029133 37249877 1.02
tpcds_q78/datafusion:parquet 109868150 112746075 0.97
tpcds_q79/datafusion:parquet 25258774 25281303 1.00
tpcds_q80/datafusion:parquet 78270740 76619663 1.02
tpcds_q81/datafusion:parquet 32628022 31578710 1.03
tpcds_q82/datafusion:parquet 18787634 18440584 1.02
tpcds_q83/datafusion:parquet 35099103 36353399 0.97
tpcds_q84/datafusion:parquet 37557770 38652617 0.97
tpcds_q85/datafusion:parquet 145882916 145715388 1.00
tpcds_q86/datafusion:parquet 15463992 15665716 0.99
tpcds_q87/datafusion:parquet 40357693 40112600 1.01
tpcds_q88/datafusion:parquet 57015950 57887882 0.98
tpcds_q89/datafusion:parquet 20924207 20722519 1.01
tpcds_q90/datafusion:parquet 13720100 13733989 1.00
tpcds_q91/datafusion:parquet 56989095 57951224 0.98
tpcds_q92/datafusion:parquet 16862359 18040963 0.93
tpcds_q93/datafusion:parquet 30939009 31187744 0.99
tpcds_q94/datafusion:parquet 18878623 18916919 1.00
tpcds_q95/datafusion:parquet 59136033 58337667 1.01
tpcds_q96/datafusion:parquet 11355015 12557352 0.90
tpcds_q97/datafusion:parquet 28615914 28434315 1.01
tpcds_q98/datafusion:parquet 20779683 20866710 1.00
tpcds_q99/datafusion:parquet 24806677 25332671 0.98
duckdb / vortex-file-compressed (0.988x ➖, 2↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 21758406 20989694 1.04
tpcds_q02/duckdb:vortex-file-compressed 36024192 32842357 1.10
tpcds_q03/duckdb:vortex-file-compressed 24738341 26586995 0.93
tpcds_q04/duckdb:vortex-file-compressed 89281122 89358374 1.00
tpcds_q05/duckdb:vortex-file-compressed 32409345 31512866 1.03
tpcds_q06/duckdb:vortex-file-compressed 30311357 30343565 1.00
tpcds_q07/duckdb:vortex-file-compressed 19244151 19314951 1.00
tpcds_q08/duckdb:vortex-file-compressed 24689739 25646838 0.96
tpcds_q09/duckdb:vortex-file-compressed 16070000 15812220 1.02
tpcds_q10/duckdb:vortex-file-compressed 34799666 34789509 1.00
tpcds_q11/duckdb:vortex-file-compressed 60738814 57570519 1.06
tpcds_q12/duckdb:vortex-file-compressed 12485953 13539570 0.92
tpcds_q13/duckdb:vortex-file-compressed 32451547 32135037 1.01
tpcds_q14/duckdb:vortex-file-compressed 94680566 97285418 0.97
tpcds_q15/duckdb:vortex-file-compressed 27039699 26208455 1.03
tpcds_q16/duckdb:vortex-file-compressed 24048724 23701733 1.01
tpcds_q17/duckdb:vortex-file-compressed 44030701 44308807 0.99
tpcds_q18/duckdb:vortex-file-compressed 35865884 36176586 0.99
tpcds_q19/duckdb:vortex-file-compressed 30433134 29598768 1.03
tpcds_q20/duckdb:vortex-file-compressed 14079114 13936723 1.01
tpcds_q21/duckdb:vortex-file-compressed 🚀 15302189 17205417 0.89
tpcds_q22/duckdb:vortex-file-compressed 72043884 69238037 1.04
tpcds_q23/duckdb:vortex-file-compressed 106450586 103531533 1.03
tpcds_q24/duckdb:vortex-file-compressed 45070587 44888244 1.00
tpcds_q25/duckdb:vortex-file-compressed 49213244 48764617 1.01
tpcds_q26/duckdb:vortex-file-compressed 17734191 19018015 0.93
tpcds_q27/duckdb:vortex-file-compressed 20388526 20824831 0.98
tpcds_q28/duckdb:vortex-file-compressed 11637635 12802079 0.91
tpcds_q29/duckdb:vortex-file-compressed 39858703 39349596 1.01
tpcds_q30/duckdb:vortex-file-compressed 24758074 24578824 1.01
tpcds_q31/duckdb:vortex-file-compressed 28261880 27474771 1.03
tpcds_q32/duckdb:vortex-file-compressed 12966338 14233348 0.91
tpcds_q33/duckdb:vortex-file-compressed 22080739 21955912 1.01
tpcds_q34/duckdb:vortex-file-compressed 22638285 22552034 1.00
tpcds_q35/duckdb:vortex-file-compressed 60160026 60100005 1.00
tpcds_q36/duckdb:vortex-file-compressed 22622376 22996294 0.98
tpcds_q37/duckdb:vortex-file-compressed 17926544 19555848 0.92
tpcds_q38/duckdb:vortex-file-compressed 32987374 36245108 0.91
tpcds_q39/duckdb:vortex-file-compressed 32591888 32929276 0.99
tpcds_q40/duckdb:vortex-file-compressed 18329778 18434697 0.99
tpcds_q41/duckdb:vortex-file-compressed 9769363 9266229 1.05
tpcds_q42/duckdb:vortex-file-compressed 12098662 11674103 1.04
tpcds_q43/duckdb:vortex-file-compressed 19968832 21495685 0.93
tpcds_q44/duckdb:vortex-file-compressed 20556775 20402778 1.01
tpcds_q45/duckdb:vortex-file-compressed 26889755 27708148 0.97
tpcds_q46/duckdb:vortex-file-compressed 30345176 30832599 0.98
tpcds_q47/duckdb:vortex-file-compressed 45645736 45842143 1.00
tpcds_q48/duckdb:vortex-file-compressed 27625431 27172772 1.02
tpcds_q49/duckdb:vortex-file-compressed 29484866 29769304 0.99
tpcds_q50/duckdb:vortex-file-compressed 29418755 31547922 0.93
tpcds_q51/duckdb:vortex-file-compressed 94333543 97945989 0.96
tpcds_q52/duckdb:vortex-file-compressed 🚀 10191593 12096709 0.84
tpcds_q53/duckdb:vortex-file-compressed 23472454 21595589 1.09
tpcds_q54/duckdb:vortex-file-compressed 25709697 26097916 0.99
tpcds_q55/duckdb:vortex-file-compressed 11313240 11562149 0.98
tpcds_q56/duckdb:vortex-file-compressed 21740739 21890758 0.99
tpcds_q57/duckdb:vortex-file-compressed 36662100 37928806 0.97
tpcds_q58/duckdb:vortex-file-compressed 28723722 29714318 0.97
tpcds_q59/duckdb:vortex-file-compressed 65658920 66238238 0.99
tpcds_q60/duckdb:vortex-file-compressed 23544078 22877445 1.03
tpcds_q61/duckdb:vortex-file-compressed 28472765 28641704 0.99
tpcds_q62/duckdb:vortex-file-compressed 14763287 14666121 1.01
tpcds_q63/duckdb:vortex-file-compressed 20504872 20440535 1.00
tpcds_q64/duckdb:vortex-file-compressed 99181191 98320322 1.01
tpcds_q65/duckdb:vortex-file-compressed 20190676 19983397 1.01
tpcds_q66/duckdb:vortex-file-compressed 25848687 28650077 0.90
tpcds_q67/duckdb:vortex-file-compressed 138118156 138434121 1.00
tpcds_q68/duckdb:vortex-file-compressed 29755204 30062592 0.99
tpcds_q69/duckdb:vortex-file-compressed 36931988 39253447 0.94
tpcds_q70/duckdb:vortex-file-compressed 38050976 37307116 1.02
tpcds_q71/duckdb:vortex-file-compressed 18444297 18649184 0.99
tpcds_q72/duckdb:vortex-file-compressed 167079896 167406197 1.00
tpcds_q73/duckdb:vortex-file-compressed 22574145 22394478 1.01
tpcds_q74/duckdb:vortex-file-compressed 38595856 39554051 0.98
tpcds_q75/duckdb:vortex-file-compressed 46708221 47485401 0.98
tpcds_q76/duckdb:vortex-file-compressed 16325877 16230489 1.01
tpcds_q77/duckdb:vortex-file-compressed 20908089 21957090 0.95
tpcds_q78/duckdb:vortex-file-compressed 71510507 73743675 0.97
tpcds_q79/duckdb:vortex-file-compressed 24943436 24738360 1.01
tpcds_q80/duckdb:vortex-file-compressed 41669362 41890874 0.99
tpcds_q81/duckdb:vortex-file-compressed 26654704 26372393 1.01
tpcds_q82/duckdb:vortex-file-compressed 50329700 49524559 1.02
tpcds_q83/duckdb:vortex-file-compressed 25163667 25485292 0.99
tpcds_q84/duckdb:vortex-file-compressed 19269213 19608425 0.98
tpcds_q85/duckdb:vortex-file-compressed 41350455 44903301 0.92
tpcds_q86/duckdb:vortex-file-compressed 15146373 16579141 0.91
tpcds_q87/duckdb:vortex-file-compressed 37674828 37183978 1.01
tpcds_q88/duckdb:vortex-file-compressed 49482264 49511064 1.00
tpcds_q89/duckdb:vortex-file-compressed 19416490 19876818 0.98
tpcds_q90/duckdb:vortex-file-compressed 9784992 9910317 0.99
tpcds_q91/duckdb:vortex-file-compressed 23367015 25313352 0.92
tpcds_q92/duckdb:vortex-file-compressed 18617439 17445869 1.07
tpcds_q93/duckdb:vortex-file-compressed 27021866 26298093 1.03
tpcds_q94/duckdb:vortex-file-compressed 20108627 19859169 1.01
tpcds_q95/duckdb:vortex-file-compressed 154208963 153773322 1.00
tpcds_q96/duckdb:vortex-file-compressed 11556209 12601784 0.92
tpcds_q97/duckdb:vortex-file-compressed 35317501 37359962 0.95
tpcds_q98/duckdb:vortex-file-compressed 17525538 17429886 1.01
tpcds_q99/duckdb:vortex-file-compressed 25711926 25047657 1.03
duckdb / vortex-compact (1.024x ➖, 0↑ 13↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 22746841 24210054 0.94
tpcds_q02/duckdb:vortex-compact 38970049 39226752 0.99
tpcds_q03/duckdb:vortex-compact 48828187 49353757 0.99
tpcds_q04/duckdb:vortex-compact 103806654 96727657 1.07
tpcds_q05/duckdb:vortex-compact 39353314 42567071 0.92
tpcds_q06/duckdb:vortex-compact 37332013 36541044 1.02
tpcds_q07/duckdb:vortex-compact 33848992 32941890 1.03
tpcds_q08/duckdb:vortex-compact 39120856 40217367 0.97
tpcds_q09/duckdb:vortex-compact 19231197 19759164 0.97
tpcds_q10/duckdb:vortex-compact 50836124 49535419 1.03
tpcds_q11/duckdb:vortex-compact 67537636 70568126 0.96
tpcds_q12/duckdb:vortex-compact 19857812 19943040 1.00
tpcds_q13/duckdb:vortex-compact 52163383 52272127 1.00
tpcds_q14/duckdb:vortex-compact 114023286 114634670 0.99
tpcds_q15/duckdb:vortex-compact 28521599 28654623 1.00
tpcds_q16/duckdb:vortex-compact 25340061 26029149 0.97
tpcds_q17/duckdb:vortex-compact 53602132 55536288 0.97
tpcds_q18/duckdb:vortex-compact 48400176 46827444 1.03
tpcds_q19/duckdb:vortex-compact 42755483 42704812 1.00
tpcds_q20/duckdb:vortex-compact 18382065 18709115 0.98
tpcds_q21/duckdb:vortex-compact 16979486 17536561 0.97
tpcds_q22/duckdb:vortex-compact 74774966 75218658 0.99
tpcds_q23/duckdb:vortex-compact 127614861 123952593 1.03
tpcds_q24/duckdb:vortex-compact 57817230 54785216 1.06
tpcds_q25/duckdb:vortex-compact 79574271 81116652 0.98
tpcds_q26/duckdb:vortex-compact 31140774 28694502 1.09
tpcds_q27/duckdb:vortex-compact 35001688 34851124 1.00
tpcds_q28/duckdb:vortex-compact 33242073 34385634 0.97
tpcds_q29/duckdb:vortex-compact 50725361 53536456 0.95
tpcds_q30/duckdb:vortex-compact 28992919 29230586 0.99
tpcds_q31/duckdb:vortex-compact 32313124 33447610 0.97
tpcds_q32/duckdb:vortex-compact 19860953 20341713 0.98
tpcds_q33/duckdb:vortex-compact 29877538 31968470 0.93
tpcds_q34/duckdb:vortex-compact 29950977 29483097 1.02
tpcds_q35/duckdb:vortex-compact 68588629 72442138 0.95
tpcds_q36/duckdb:vortex-compact 33853221 34281277 0.99
tpcds_q37/duckdb:vortex-compact 23926763 23036933 1.04
tpcds_q38/duckdb:vortex-compact 39482775 38444818 1.03
tpcds_q39/duckdb:vortex-compact 34770545 36120482 0.96
tpcds_q40/duckdb:vortex-compact 22440670 21997238 1.02
tpcds_q41/duckdb:vortex-compact 10960321 10945279 1.00
tpcds_q42/duckdb:vortex-compact 18436247 18547763 0.99
tpcds_q43/duckdb:vortex-compact 31080378 30417733 1.02
tpcds_q44/duckdb:vortex-compact 28221480 28763234 0.98
tpcds_q45/duckdb:vortex-compact 33243129 34685769 0.96
tpcds_q46/duckdb:vortex-compact 42870294 45257095 0.95
tpcds_q47/duckdb:vortex-compact 55302814 55409481 1.00
tpcds_q48/duckdb:vortex-compact 44994683 45271773 0.99
tpcds_q49/duckdb:vortex-compact 44407334 48362019 0.92
tpcds_q50/duckdb:vortex-compact 36409028 36892463 0.99
tpcds_q51/duckdb:vortex-compact 103786998 100192207 1.04
tpcds_q52/duckdb:vortex-compact 18795096 18187375 1.03
tpcds_q53/duckdb:vortex-compact 31904508 31779458 1.00
tpcds_q54/duckdb:vortex-compact 34546473 36408114 0.95
tpcds_q55/duckdb:vortex-compact 17798517 18836688 0.94
tpcds_q56/duckdb:vortex-compact 29784112 29270253 1.02
tpcds_q57/duckdb:vortex-compact 41169957 42294878 0.97
tpcds_q58/duckdb:vortex-compact 37968186 37223662 1.02
tpcds_q59/duckdb:vortex-compact 88785897 86909042 1.02
tpcds_q60/duckdb:vortex-compact 33691781 34234394 0.98
tpcds_q61/duckdb:vortex-compact 52541659 52333890 1.00
tpcds_q62/duckdb:vortex-compact 21503920 20008267 1.07
tpcds_q63/duckdb:vortex-compact 31012600 31700493 0.98
tpcds_q64/duckdb:vortex-compact 141358965 132893235 1.06
tpcds_q65/duckdb:vortex-compact 31331250 29419882 1.06
tpcds_q66/duckdb:vortex-compact 🚨 40532650 35056836 1.16
tpcds_q67/duckdb:vortex-compact 🚨 170991673 146686669 1.17
tpcds_q68/duckdb:vortex-compact 🚨 51635793 46577708 1.11
tpcds_q69/duckdb:vortex-compact 🚨 60214312 53558900 1.12
tpcds_q70/duckdb:vortex-compact 62067831 58992851 1.05
tpcds_q71/duckdb:vortex-compact 🚨 30618207 27541195 1.11
tpcds_q72/duckdb:vortex-compact 199935767 183305325 1.09
tpcds_q73/duckdb:vortex-compact 🚨 31167511 26908733 1.16
tpcds_q74/duckdb:vortex-compact 50036790 47131405 1.06
tpcds_q75/duckdb:vortex-compact 🚨 65892821 54804175 1.20
tpcds_q76/duckdb:vortex-compact 30085293 28831071 1.04
tpcds_q77/duckdb:vortex-compact 39011021 36103482 1.08
tpcds_q78/duckdb:vortex-compact 92083275 84542115 1.09
tpcds_q79/duckdb:vortex-compact 🚨 45570236 40772225 1.12
tpcds_q80/duckdb:vortex-compact 74990387 71164751 1.05
tpcds_q81/duckdb:vortex-compact 🚨 37201126 32290044 1.15
tpcds_q82/duckdb:vortex-compact 54828588 50950891 1.08
tpcds_q83/duckdb:vortex-compact 🚨 41538860 34091264 1.22
tpcds_q84/duckdb:vortex-compact 🚨 29654919 25708868 1.15
tpcds_q85/duckdb:vortex-compact 56934237 55714692 1.02
tpcds_q86/duckdb:vortex-compact 🚨 22915065 18879989 1.21
tpcds_q87/duckdb:vortex-compact 41923956 42513714 0.99
tpcds_q88/duckdb:vortex-compact 75435575 74773446 1.01
tpcds_q89/duckdb:vortex-compact 30374717 29983644 1.01
tpcds_q90/duckdb:vortex-compact 10584315 10279800 1.03
tpcds_q91/duckdb:vortex-compact 43928345 42347648 1.04
tpcds_q92/duckdb:vortex-compact 42889608 47299215 0.91
tpcds_q93/duckdb:vortex-compact 31144833 30464549 1.02
tpcds_q94/duckdb:vortex-compact 27961809 26220432 1.07
tpcds_q95/duckdb:vortex-compact 151981902 152618356 1.00
tpcds_q96/duckdb:vortex-compact 16947683 16218418 1.04
tpcds_q97/duckdb:vortex-compact 42079271 38715328 1.09
tpcds_q98/duckdb:vortex-compact 🚨 28151642 24944522 1.13
tpcds_q99/duckdb:vortex-compact 30346031 29096444 1.04
duckdb / parquet (0.995x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 26476684 27855358 0.95
tpcds_q02/duckdb:parquet 23200293 24090242 0.96
tpcds_q03/duckdb:parquet 11259281 11333862 0.99
tpcds_q04/duckdb:parquet 168079633 168866811 1.00
tpcds_q05/duckdb:parquet 29581009 28788579 1.03
tpcds_q06/duckdb:parquet 27489206 28142392 0.98
tpcds_q07/duckdb:parquet 20472529 20838930 0.98
tpcds_q08/duckdb:parquet 25963699 26715672 0.97
tpcds_q09/duckdb:parquet 39361042 39104148 1.01
tpcds_q10/duckdb:parquet 31984760 33554252 0.95
tpcds_q11/duckdb:parquet 85046645 87754942 0.97
tpcds_q12/duckdb:parquet 14543927 14880146 0.98
tpcds_q13/duckdb:parquet 32580912 33690096 0.97
tpcds_q14/duckdb:parquet 98502393 100785090 0.98
tpcds_q15/duckdb:parquet 29577800 29877864 0.99
tpcds_q16/duckdb:parquet 20568899 22660804 0.91
tpcds_q17/duckdb:parquet 36787286 38128790 0.96
tpcds_q18/duckdb:parquet 45479504 44993709 1.01
tpcds_q19/duckdb:parquet 28240408 28538263 0.99
tpcds_q20/duckdb:parquet 15105931 15482925 0.98
tpcds_q21/duckdb:parquet 9951157 9739109 1.02
tpcds_q22/duckdb:parquet 68085811 69785425 0.98
tpcds_q23/duckdb:parquet 84798748 78834302 1.08
tpcds_q24/duckdb:parquet 43893361 42418285 1.03
tpcds_q25/duckdb:parquet 32271562 31948944 1.01
tpcds_q26/duckdb:parquet 35540948 34551127 1.03
tpcds_q27/duckdb:parquet 47759614 47770491 1.00
tpcds_q28/duckdb:parquet 37752285 37176240 1.02
tpcds_q29/duckdb:parquet 35509013 36491797 0.97
tpcds_q30/duckdb:parquet 35088882 34208137 1.03
tpcds_q31/duckdb:parquet 22583784 22430604 1.01
tpcds_q32/duckdb:parquet 10753202 11185385 0.96
tpcds_q33/duckdb:parquet 20541056 20725088 0.99
tpcds_q34/duckdb:parquet 19567195 19746486 0.99
tpcds_q35/duckdb:parquet 54513416 57969614 0.94
tpcds_q36/duckdb:parquet 19450575 20991648 0.93
tpcds_q37/duckdb:parquet 12460486 12180497 1.02
tpcds_q38/duckdb:parquet 32422766 33709586 0.96
tpcds_q39/duckdb:parquet 27988714 28556439 0.98
tpcds_q40/duckdb:parquet 17113169 17506103 0.98
tpcds_q41/duckdb:parquet 7531793 7482941 1.01
tpcds_q42/duckdb:parquet 9562223 9529627 1.00
tpcds_q43/duckdb:parquet 14910367 14991500 0.99
tpcds_q44/duckdb:parquet 22099195 21917434 1.01
tpcds_q45/duckdb:parquet 25540774 25736496 0.99
tpcds_q46/duckdb:parquet 44199024 43243530 1.02
tpcds_q47/duckdb:parquet 44651592 44520447 1.00
tpcds_q48/duckdb:parquet 30147623 28746725 1.05
tpcds_q49/duckdb:parquet 24266949 23468357 1.03
tpcds_q50/duckdb:parquet 24355553 23808005 1.02
tpcds_q51/duckdb:parquet 94302310 91039714 1.04
tpcds_q52/duckdb:parquet 10071497 9844729 1.02
tpcds_q53/duckdb:parquet 14740177 15725403 0.94
tpcds_q54/duckdb:parquet 24457518 24978051 0.98
tpcds_q55/duckdb:parquet 9556209 9894912 0.97
tpcds_q56/duckdb:parquet 20298778 20228904 1.00
tpcds_q57/duckdb:parquet 33794907 34276789 0.99
tpcds_q58/duckdb:parquet 22075285 22725556 0.97
tpcds_q59/duckdb:parquet 35420648 34929047 1.01
tpcds_q60/duckdb:parquet 21218136 20872172 1.02
tpcds_q61/duckdb:parquet 30259058 30930214 0.98
tpcds_q62/duckdb:parquet 11609768 11685362 0.99
tpcds_q63/duckdb:parquet 13705748 13942578 0.98
tpcds_q64/duckdb:parquet 73379994 73689025 1.00
tpcds_q65/duckdb:parquet 19323877 19211410 1.01
tpcds_q66/duckdb:parquet 29693723 29614397 1.00
tpcds_q67/duckdb:parquet 135670784 133106405 1.02
tpcds_q68/duckdb:parquet 35399408 36279440 0.98
tpcds_q69/duckdb:parquet 36405949 35393010 1.03
tpcds_q70/duckdb:parquet 19019734 18956342 1.00
tpcds_q71/duckdb:parquet 18731059 18328329 1.02
tpcds_q72/duckdb:parquet 163465091 164061242 1.00
tpcds_q73/duckdb:parquet 17407717 17152897 1.01
tpcds_q74/duckdb:parquet 125485097 128922726 0.97
tpcds_q75/duckdb:parquet 52126815 53419285 0.98
tpcds_q76/duckdb:parquet 18644520 18744947 0.99
tpcds_q77/duckdb:parquet 21247333 22011959 0.97
tpcds_q78/duckdb:parquet 73955992 73548159 1.01
tpcds_q79/duckdb:parquet 26997306 26484582 1.02
tpcds_q80/duckdb:parquet 39075548 38713220 1.01
tpcds_q81/duckdb:parquet 31000127 30498250 1.02
tpcds_q82/duckdb:parquet 13661955 13075751 1.04
tpcds_q83/duckdb:parquet 15583069 17127165 0.91
tpcds_q84/duckdb:parquet 19966393 18352974 1.09
tpcds_q85/duckdb:parquet 37840270 36717502 1.03
tpcds_q86/duckdb:parquet 12249771 11961725 1.02
tpcds_q87/duckdb:parquet 35562585 35465063 1.00
tpcds_q88/duckdb:parquet 48125654 48625392 0.99
tpcds_q89/duckdb:parquet 16043340 16025196 1.00
tpcds_q90/duckdb:parquet 7769734 7312266 1.06
tpcds_q91/duckdb:parquet 22371850 22498493 0.99
tpcds_q92/duckdb:parquet 10927217 10624175 1.03
tpcds_q93/duckdb:parquet 27582139 29035264 0.95
tpcds_q94/duckdb:parquet 15863923 16883473 0.94
tpcds_q95/duckdb:parquet 141758257 139883512 1.01
tpcds_q96/duckdb:parquet 8197835 8385068 0.98
tpcds_q97/duckdb:parquet 33524835 35141095 0.95
tpcds_q98/duckdb:parquet 17938233 17199016 1.04
tpcds_q99/duckdb:parquet 19248897 19726683 0.98
duckdb / duckdb (1.157x ❌, 0↑ 84↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 🚨 23945903 20409887 1.17
tpcds_q02/duckdb:duckdb 🚨 20080316 18129079 1.11
tpcds_q03/duckdb:duckdb 🚨 10345834 8330552 1.24
tpcds_q04/duckdb:duckdb 🚨 189245961 171997593 1.10
tpcds_q05/duckdb:duckdb 21157545 19883177 1.06
tpcds_q06/duckdb:duckdb 🚨 27406584 22603488 1.21
tpcds_q07/duckdb:duckdb 🚨 43341414 38399878 1.13
tpcds_q08/duckdb:duckdb 123293611 120890086 1.02
tpcds_q09/duckdb:duckdb 🚨 21898829 19790628 1.11
tpcds_q10/duckdb:duckdb 🚨 26680660 23364167 1.14
tpcds_q11/duckdb:duckdb 🚨 96537769 82813826 1.17
tpcds_q12/duckdb:duckdb 12302218 12063036 1.02
tpcds_q13/duckdb:duckdb 26983130 24707742 1.09
tpcds_q14/duckdb:duckdb 99700520 92289740 1.08
tpcds_q15/duckdb:duckdb 🚨 28250995 25223788 1.12
tpcds_q16/duckdb:duckdb 🚨 21542403 17378140 1.24
tpcds_q17/duckdb:duckdb 🚨 25353463 21082360 1.20
tpcds_q18/duckdb:duckdb 🚨 49069251 43249820 1.13
tpcds_q19/duckdb:duckdb 🚨 24835661 16241143 1.53
tpcds_q20/duckdb:duckdb 🚨 13456979 11995816 1.12
tpcds_q21/duckdb:duckdb 🚨 8023119 6437589 1.25
tpcds_q22/duckdb:duckdb 🚨 73948585 59674897 1.24
tpcds_q23/duckdb:duckdb 🚨 85382641 70651150 1.21
tpcds_q24/duckdb:duckdb 🚨 26237815 23685260 1.11
tpcds_q25/duckdb:duckdb 🚨 20375378 16536614 1.23
tpcds_q26/duckdb:duckdb 🚨 30741341 24988585 1.23
tpcds_q27/duckdb:duckdb 🚨 43906298 38848483 1.13
tpcds_q28/duckdb:duckdb 🚨 23808747 21471948 1.11
tpcds_q29/duckdb:duckdb 🚨 22895303 20427318 1.12
tpcds_q30/duckdb:duckdb 🚨 33033201 25285299 1.31
tpcds_q31/duckdb:duckdb 🚨 55953189 47235722 1.18
tpcds_q32/duckdb:duckdb 🚨 8376652 6785112 1.23
tpcds_q33/duckdb:duckdb 🚨 14223648 12677301 1.12
tpcds_q34/duckdb:duckdb 🚨 16328539 14497181 1.13
tpcds_q35/duckdb:duckdb 🚨 37479314 33346996 1.12
tpcds_q36/duckdb:duckdb 🚨 79590150 67453216 1.18
tpcds_q37/duckdb:duckdb 🚨 8981944 7056540 1.27
tpcds_q38/duckdb:duckdb 33484795 30480905 1.10
tpcds_q39/duckdb:duckdb 🚨 28426420 24117865 1.18
tpcds_q40/duckdb:duckdb 🚨 15265014 13067402 1.17
tpcds_q41/duckdb:duckdb 🚨 9646845 7846536 1.23
tpcds_q42/duckdb:duckdb 🚨 7508180 6245741 1.20
tpcds_q43/duckdb:duckdb 🚨 12542466 10881654 1.15
tpcds_q44/duckdb:duckdb 15430656 14329426 1.08
tpcds_q45/duckdb:duckdb 🚨 21111718 16926344 1.25
tpcds_q46/duckdb:duckdb 🚨 43012459 36751592 1.17
tpcds_q47/duckdb:duckdb 🚨 47312401 38256283 1.24
tpcds_q48/duckdb:duckdb 23768811 22404654 1.06
tpcds_q49/duckdb:duckdb 🚨 20767963 16840778 1.23
tpcds_q50/duckdb:duckdb 🚨 16298889 13997259 1.16
tpcds_q51/duckdb:duckdb 🚨 101640224 88480640 1.15
tpcds_q52/duckdb:duckdb 🚨 8192230 7158656 1.14
tpcds_q53/duckdb:duckdb 🚨 14652865 13227517 1.11
tpcds_q54/duckdb:duckdb 🚨 19101291 15855011 1.20
tpcds_q55/duckdb:duckdb 🚨 8386394 6775821 1.24
tpcds_q56/duckdb:duckdb 🚨 15656435 13162113 1.19
tpcds_q57/duckdb:duckdb 35413052 33069325 1.07
tpcds_q58/duckdb:duckdb 14388973 13507893 1.07
tpcds_q59/duckdb:duckdb 🚨 39803267 35277568 1.13
tpcds_q60/duckdb:duckdb 🚨 17285331 15191916 1.14
tpcds_q61/duckdb:duckdb 🚨 17503303 14261462 1.23
tpcds_q62/duckdb:duckdb 🚨 10701160 9385815 1.14
tpcds_q63/duckdb:duckdb 🚨 13842710 12191576 1.14
tpcds_q64/duckdb:duckdb 🚨 60477701 54447640 1.11
tpcds_q65/duckdb:duckdb 38216101 35105877 1.09
tpcds_q66/duckdb:duckdb 28452983 26024479 1.09
tpcds_q67/duckdb:duckdb 🚨 146071024 127604374 1.14
tpcds_q68/duckdb:duckdb 🚨 28026389 25104546 1.12
tpcds_q69/duckdb:duckdb 🚨 28123560 24374763 1.15
tpcds_q70/duckdb:duckdb 🚨 16427796 13803070 1.19
tpcds_q71/duckdb:duckdb 🚨 14982786 12954692 1.16
tpcds_q72/duckdb:duckdb 🚨 47328068 42769150 1.11
tpcds_q73/duckdb:duckdb 🚨 12721052 11312644 1.12
tpcds_q74/duckdb:duckdb 155145781 141830537 1.09
tpcds_q75/duckdb:duckdb 🚨 46364723 41187574 1.13
tpcds_q76/duckdb:duckdb 12981088 12185613 1.07
tpcds_q77/duckdb:duckdb 🚨 13669931 12401554 1.10
tpcds_q78/duckdb:duckdb 🚨 71045514 61193215 1.16
tpcds_q79/duckdb:duckdb 🚨 21334742 18698202 1.14
tpcds_q80/duckdb:duckdb 🚨 30826988 27682475 1.11
tpcds_q81/duckdb:duckdb 🚨 43048642 38601991 1.12
tpcds_q82/duckdb:duckdb 🚨 10155289 8229867 1.23
tpcds_q83/duckdb:duckdb 🚨 11014500 8602438 1.28
tpcds_q84/duckdb:duckdb 🚨 15737632 12934256 1.22
tpcds_q85/duckdb:duckdb 🚨 29330914 22948508 1.28
tpcds_q86/duckdb:duckdb 🚨 12039108 10300409 1.17
tpcds_q87/duckdb:duckdb 🚨 37147987 31463284 1.18
tpcds_q88/duckdb:duckdb 🚨 28568604 25270909 1.13
tpcds_q89/duckdb:duckdb 🚨 16672638 14366239 1.16
tpcds_q90/duckdb:duckdb 🚨 6677709 5404796 1.24
tpcds_q91/duckdb:duckdb 🚨 15365469 12247757 1.25
tpcds_q92/duckdb:duckdb 🚨 10296850 9101948 1.13
tpcds_q93/duckdb:duckdb 🚨 23985770 21355958 1.12
tpcds_q94/duckdb:duckdb 🚨 15105785 12785285 1.18
tpcds_q95/duckdb:duckdb 117362355 112356555 1.04
tpcds_q96/duckdb:duckdb 🚨 5283602 4572964 1.16
tpcds_q97/duckdb:duckdb 🚨 34462496 28968546 1.19
tpcds_q98/duckdb:duckdb 🚨 15357752 13960396 1.10
tpcds_q99/duckdb:duckdb 🚨 18541417 16163123 1.15
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -2.7% -5.0% +2.4% +28.2% ➖ noise
1 datafusion:vortex-file-compressed +0.0% -5.0% +5.2% +24.9% ➖ noise
1 duckdb:duckdb +17.3% -5.0% +23.5% +25.0% ➖ noise
1 duckdb:vortex-compact -6.0% -5.0% -1.1% +25.0% ➖ noise
1 duckdb:vortex-file-compressed +3.7% -5.0% +9.1% +34.0% ➖ noise
2 datafusion:vortex-compact -2.1% -2.6% +0.6% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +1.0% -2.6% +3.7% +10.0% ➖ noise
2 duckdb:duckdb +10.8% -2.6% +13.8% +10.0% 🚨 regression
2 duckdb:vortex-compact -0.7% -2.6% +2.0% +25.6% ➖ noise
2 duckdb:vortex-file-compressed +9.7% -2.6% +12.6% +29.6% ➖ noise
3 datafusion:vortex-compact +0.5% -0.2% +0.7% +10.6% ➖ noise
3 datafusion:vortex-file-compressed +5.3% -0.2% +5.6% +10.0% ➖ noise
3 duckdb:duckdb +24.2% -0.2% +24.5% +10.7% 🚨 regression
3 duckdb:vortex-compact -1.1% -0.2% -0.9% +11.0% ➖ noise
3 duckdb:vortex-file-compressed -7.0% -0.2% -6.8% +10.5% ➖ noise
4 datafusion:vortex-compact +3.1% -2.2% +5.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +2.7% -2.2% +5.0% +10.0% ➖ noise
4 duckdb:duckdb +10.0% -2.2% +12.5% +12.5% ➖ noise
4 duckdb:vortex-compact +7.3% -2.2% +9.7% +10.7% ➖ noise
4 duckdb:vortex-file-compressed -0.1% -2.2% +2.1% +13.7% ➖ noise
5 datafusion:vortex-compact -3.6% -0.1% -3.5% +18.1% ➖ noise
5 datafusion:vortex-file-compressed +0.1% -0.1% +0.2% +20.7% ➖ noise
5 duckdb:duckdb +6.4% -0.1% +6.5% +11.6% ➖ noise
5 duckdb:vortex-compact -7.5% -0.1% -7.5% +17.2% ➖ noise
5 duckdb:vortex-file-compressed +2.8% -0.1% +2.9% +10.0% ➖ noise
6 datafusion:vortex-compact +2.8% -2.2% +5.1% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +2.3% -2.2% +4.6% +10.0% ➖ noise
6 duckdb:duckdb +21.2% -2.2% +24.0% +16.9% 🚨 regression
6 duckdb:vortex-compact +2.2% -2.2% +4.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -0.1% -2.2% +2.1% +10.0% ➖ noise
7 datafusion:vortex-compact -4.3% +1.6% -5.8% +10.9% ➖ noise
7 datafusion:vortex-file-compressed +3.5% +1.6% +1.9% +10.0% ➖ noise
7 duckdb:duckdb +12.9% +1.6% +11.1% +20.1% ➖ noise
7 duckdb:vortex-compact +2.8% +1.6% +1.1% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.4% +1.6% -2.0% +10.0% ➖ noise
8 datafusion:vortex-compact -1.0% -1.0% +0.1% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +1.3% -1.0% +2.3% +10.0% ➖ noise
8 duckdb:duckdb +2.0% -1.0% +3.1% +10.0% ➖ noise
8 duckdb:vortex-compact -2.7% -1.0% -1.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.7% -1.0% -2.7% +16.7% ➖ noise
9 datafusion:vortex-compact -4.7% +0.7% -5.3% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -2.0% +0.7% -2.6% +10.3% ➖ noise
9 duckdb:duckdb +10.7% +0.7% +9.9% +10.0% ➖ noise
9 duckdb:vortex-compact -2.7% +0.7% -3.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.6% +0.7% +0.9% +13.3% ➖ noise
10 datafusion:vortex-compact +0.0% -2.0% +2.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +1.5% -2.0% +3.6% +12.1% ➖ noise
10 duckdb:duckdb +14.2% -2.0% +16.6% +10.0% 🚨 regression
10 duckdb:vortex-compact +2.6% -2.0% +4.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +0.0% -2.0% +2.1% +10.0% ➖ noise
11 datafusion:vortex-compact -4.3% +0.3% -4.5% +10.9% ➖ noise
11 datafusion:vortex-file-compressed +2.3% +0.3% +2.0% +10.8% ➖ noise
11 duckdb:duckdb +16.6% +0.3% +16.2% +15.3% 🚨 regression
11 duckdb:vortex-compact -4.3% +0.3% -4.6% +11.6% ➖ noise
11 duckdb:vortex-file-compressed +5.5% +0.3% +5.2% +11.9% ➖ noise
12 datafusion:vortex-compact -7.1% -0.5% -6.6% +18.3% ➖ noise
12 datafusion:vortex-file-compressed -9.8% -0.5% -9.3% +12.6% ➖ noise
12 duckdb:duckdb +2.0% -0.5% +2.5% +15.4% ➖ noise
12 duckdb:vortex-compact -0.4% -0.5% +0.1% +25.6% ➖ noise
12 duckdb:vortex-file-compressed -7.8% -0.5% -7.3% +25.2% ➖ noise
13 datafusion:vortex-compact +21.6% -1.4% +23.3% +20.4% 🚨 regression
13 datafusion:vortex-file-compressed -1.7% -1.4% -0.3% +10.0% ➖ noise
13 duckdb:duckdb +9.2% -1.4% +10.8% +10.0% 🚨 regression
13 duckdb:vortex-compact -0.2% -1.4% +1.2% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +1.0% -1.4% +2.4% +15.7% ➖ noise
14 datafusion:vortex-compact +2.8% -2.3% +5.2% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +0.1% -2.3% +2.5% +10.0% ➖ noise
14 duckdb:duckdb +8.0% -2.3% +10.6% +10.0% 🚨 regression
14 duckdb:vortex-compact -0.5% -2.3% +1.8% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.7% -2.3% -0.4% +10.0% ➖ noise
15 datafusion:vortex-compact -2.0% -3.8% +1.9% +16.7% ➖ noise
15 datafusion:vortex-file-compressed -0.5% -3.8% +3.4% +10.0% ➖ noise
15 duckdb:duckdb +12.0% -3.8% +16.4% +22.6% ➖ noise
15 duckdb:vortex-compact -0.5% -3.8% +3.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed +3.2% -3.8% +7.2% +14.7% ➖ noise
16 datafusion:vortex-compact -2.6% -9.7% +7.8% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -1.8% -9.7% +8.7% +10.0% ➖ noise
16 duckdb:duckdb +24.0% -9.7% +37.2% +13.1% 🚨 regression
16 duckdb:vortex-compact -2.6% -9.7% +7.8% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.5% -9.7% +12.3% +15.1% ➖ noise
17 datafusion:vortex-compact +0.2% -2.2% +2.4% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +2.8% -2.2% +5.1% +10.0% ➖ noise
17 duckdb:duckdb +20.3% -2.2% +22.9% +10.7% 🚨 regression
17 duckdb:vortex-compact -3.5% -2.2% -1.3% +10.9% ➖ noise
17 duckdb:vortex-file-compressed -0.6% -2.2% +1.6% +10.0% ➖ noise
18 datafusion:vortex-compact +0.7% +0.2% +0.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -0.4% +0.2% -0.6% +10.0% ➖ noise
18 duckdb:duckdb +13.5% +0.2% +13.2% +10.0% 🚨 regression
18 duckdb:vortex-compact +3.4% +0.2% +3.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -0.9% +0.2% -1.1% +10.0% ➖ noise
19 datafusion:vortex-compact -0.1% -0.5% +0.4% +10.9% ➖ noise
19 datafusion:vortex-file-compressed -1.9% -0.5% -1.4% +13.3% ➖ noise
19 duckdb:duckdb +52.9% -0.5% +53.7% +21.8% 🚨 regression
19 duckdb:vortex-compact +0.1% -0.5% +0.6% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +2.8% -0.5% +3.4% +13.4% ➖ noise
20 datafusion:vortex-compact -3.2% -1.7% -1.5% +10.4% ➖ noise
20 datafusion:vortex-file-compressed -4.5% -1.7% -2.8% +10.0% ➖ noise
20 duckdb:duckdb +12.2% -1.7% +14.2% +11.2% 🚨 regression
20 duckdb:vortex-compact -1.7% -1.7% -0.0% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.0% -1.7% +2.8% +10.0% ➖ noise
21 datafusion:vortex-compact +2.8% +1.2% +1.6% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -1.6% +1.2% -2.7% +10.0% ➖ noise
21 duckdb:duckdb +24.6% +1.2% +23.1% +19.8% 🚨 regression
21 duckdb:vortex-compact -3.2% +1.2% -4.3% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -11.1% +1.2% -12.1% +10.4% ✅ faster
22 datafusion:vortex-compact -10.3% -1.5% -8.9% +29.8% ➖ noise
22 datafusion:vortex-file-compressed -23.7% -1.5% -22.5% +35.2% ➖ noise
22 duckdb:duckdb +23.9% -1.5% +25.8% +12.0% 🚨 regression
22 duckdb:vortex-compact -0.6% -1.5% +0.9% +11.5% ➖ noise
22 duckdb:vortex-file-compressed +4.1% -1.5% +5.6% +12.7% ➖ noise
23 datafusion:vortex-compact +1.0% +5.0% -3.8% +10.0% ➖ noise
23 datafusion:vortex-file-compressed -3.4% +5.0% -8.0% +10.0% ➖ noise
23 duckdb:duckdb +20.9% +5.0% +15.1% +13.7% 🚨 regression
23 duckdb:vortex-compact +3.0% +5.0% -2.0% +17.8% ➖ noise
23 duckdb:vortex-file-compressed +2.8% +5.0% -2.1% +14.9% ➖ noise
24 datafusion:vortex-compact -3.4% +0.5% -3.8% +10.0% ➖ noise
24 datafusion:vortex-file-compressed -2.9% +0.5% -3.3% +10.0% ➖ noise
24 duckdb:duckdb +10.8% +0.5% +10.3% +10.0% 🚨 regression
24 duckdb:vortex-compact +5.5% +0.5% +5.1% +12.3% ➖ noise
24 duckdb:vortex-file-compressed +0.4% +0.5% -0.1% +10.0% ➖ noise
25 datafusion:vortex-compact +0.4% +0.6% -0.2% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +0.7% +0.6% +0.1% +10.0% ➖ noise
25 duckdb:duckdb +23.2% +0.6% +22.5% +16.1% 🚨 regression
25 duckdb:vortex-compact -1.9% +0.6% -2.5% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +0.9% +0.6% +0.3% +15.9% ➖ noise
26 datafusion:vortex-compact +1.7% +2.9% -1.2% +16.8% ➖ noise
26 datafusion:vortex-file-compressed +2.0% +2.9% -1.0% +11.7% ➖ noise
26 duckdb:duckdb +23.0% +2.9% +19.5% +13.8% 🚨 regression
26 duckdb:vortex-compact +8.5% +2.9% +5.4% +15.9% ➖ noise
26 duckdb:vortex-file-compressed -6.8% +2.9% -9.4% +10.3% ✅ faster
27 datafusion:vortex-compact +3.3% -0.9% +4.2% +10.3% ➖ noise
27 datafusion:vortex-file-compressed +0.2% -0.9% +1.1% +14.9% ➖ noise
27 duckdb:duckdb +13.0% -0.9% +14.0% +18.6% ➖ noise
27 duckdb:vortex-compact +0.4% -0.9% +1.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -2.1% -0.9% -1.2% +10.0% ➖ noise
28 datafusion:vortex-compact -0.8% +1.3% -2.1% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.9% +1.3% +1.6% +10.0% ➖ noise
28 duckdb:duckdb +10.9% +1.3% +9.5% +10.0% ➖ noise
28 duckdb:vortex-compact -3.3% +1.3% -4.5% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -9.1% +1.3% -10.2% +14.1% ➖ noise
29 datafusion:vortex-compact +3.4% -1.1% +4.5% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +3.1% -1.1% +4.2% +10.0% ➖ noise
29 duckdb:duckdb +12.1% -1.1% +13.3% +10.0% 🚨 regression
29 duckdb:vortex-compact -5.3% -1.1% -4.2% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +1.3% -1.1% +2.4% +10.0% ➖ noise
30 datafusion:vortex-compact +5.5% +2.1% +3.3% +11.9% ➖ noise
30 datafusion:vortex-file-compressed +8.7% +2.1% +6.5% +15.6% ➖ noise
30 duckdb:duckdb +30.6% +2.1% +27.9% +13.3% 🚨 regression
30 duckdb:vortex-compact -0.8% +2.1% -2.9% +12.4% ➖ noise
30 duckdb:vortex-file-compressed +0.7% +2.1% -1.4% +16.3% ➖ noise
31 datafusion:vortex-compact -1.5% -0.2% -1.3% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -1.6% -0.2% -1.4% +10.0% ➖ noise
31 duckdb:duckdb +18.5% -0.2% +18.7% +10.0% 🚨 regression
31 duckdb:vortex-compact -3.4% -0.2% -3.2% +10.5% ➖ noise
31 duckdb:vortex-file-compressed +2.9% -0.2% +3.1% +15.7% ➖ noise
32 datafusion:vortex-compact -1.1% -1.9% +0.8% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +1.2% -1.9% +3.2% +10.0% ➖ noise
32 duckdb:duckdb +23.5% -1.9% +25.8% +16.3% 🚨 regression
32 duckdb:vortex-compact -2.4% -1.9% -0.5% +15.7% ➖ noise
32 duckdb:vortex-file-compressed -8.9% -1.9% -7.1% +10.0% ➖ noise
33 datafusion:vortex-compact -1.5% +0.9% -2.4% +10.0% ➖ noise
33 datafusion:vortex-file-compressed -1.7% +0.9% -2.6% +14.2% ➖ noise
33 duckdb:duckdb +12.2% +0.9% +11.2% +11.7% ➖ noise
33 duckdb:vortex-compact -6.5% +0.9% -7.4% +12.7% ➖ noise
33 duckdb:vortex-file-compressed +0.6% +0.9% -0.3% +10.4% ➖ noise
34 datafusion:vortex-compact +1.6% -0.4% +2.0% +14.1% ➖ noise
34 datafusion:vortex-file-compressed +1.6% -0.4% +2.0% +10.7% ➖ noise
34 duckdb:duckdb +12.6% -0.4% +13.1% +12.0% 🚨 regression
34 duckdb:vortex-compact +1.6% -0.4% +2.0% +16.8% ➖ noise
34 duckdb:vortex-file-compressed +0.4% -0.4% +0.8% +10.6% ➖ noise
35 datafusion:vortex-compact -3.5% -4.6% +1.2% +11.9% ➖ noise
35 datafusion:vortex-file-compressed +0.4% -4.6% +5.2% +10.0% ➖ noise
35 duckdb:duckdb +12.4% -4.6% +17.8% +10.2% 🚨 regression
35 duckdb:vortex-compact -5.3% -4.6% -0.7% +11.0% ➖ noise
35 duckdb:vortex-file-compressed +0.1% -4.6% +4.9% +16.7% ➖ noise
36 datafusion:vortex-compact -0.2% -4.3% +4.2% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -1.2% -4.3% +3.2% +10.0% ➖ noise
36 duckdb:duckdb +18.0% -4.3% +23.3% +10.0% 🚨 regression
36 duckdb:vortex-compact -1.2% -4.3% +3.2% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -1.6% -4.3% +2.8% +10.0% ➖ noise
37 datafusion:vortex-compact -2.0% +1.9% -3.8% +10.0% ➖ noise
37 datafusion:vortex-file-compressed -3.8% +1.9% -5.5% +10.0% ➖ noise
37 duckdb:duckdb +27.3% +1.9% +25.0% +13.5% 🚨 regression
37 duckdb:vortex-compact +3.9% +1.9% +2.0% +13.6% ➖ noise
37 duckdb:vortex-file-compressed -8.3% +1.9% -10.0% +10.4% ✅ faster
38 datafusion:vortex-compact +6.5% -2.4% +9.1% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -0.4% -2.4% +2.1% +10.0% ➖ noise
38 duckdb:duckdb +9.9% -2.4% +12.6% +11.8% 🚨 regression
38 duckdb:vortex-compact +2.7% -2.4% +5.2% +12.4% ➖ noise
38 duckdb:vortex-file-compressed -9.0% -2.4% -6.7% +10.0% ➖ noise
39 datafusion:vortex-compact -4.9% -1.4% -3.6% +10.0% ➖ noise
39 datafusion:vortex-file-compressed -0.5% -1.4% +0.9% +10.0% ➖ noise
39 duckdb:duckdb +17.9% -1.4% +19.5% +21.3% ➖ noise
39 duckdb:vortex-compact -3.7% -1.4% -2.4% +15.8% ➖ noise
39 duckdb:vortex-file-compressed -1.0% -1.4% +0.3% +10.0% ➖ noise
40 datafusion:vortex-compact +0.3% -0.1% +0.4% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +2.2% -0.1% +2.3% +10.0% ➖ noise
40 duckdb:duckdb +16.8% -0.1% +16.9% +10.9% 🚨 regression
40 duckdb:vortex-compact +2.0% -0.1% +2.1% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -0.6% -0.1% -0.5% +14.2% ➖ noise
41 datafusion:vortex-compact +0.1% +0.1% +0.0% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +0.1% +0.1% +0.0% +10.0% ➖ noise
41 duckdb:duckdb +22.9% +0.1% +22.8% +10.0% 🚨 regression
41 duckdb:vortex-compact +0.1% +0.1% +0.0% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +5.4% +0.1% +5.3% +12.9% ➖ noise
42 datafusion:vortex-compact +0.4% -0.3% +0.7% +10.0% ➖ noise
42 datafusion:vortex-file-compressed +2.9% -0.3% +3.2% +10.0% ➖ noise
42 duckdb:duckdb +20.2% -0.3% +20.6% +15.7% 🚨 regression
42 duckdb:vortex-compact -0.6% -0.3% -0.3% +17.5% ➖ noise
42 duckdb:vortex-file-compressed +3.6% -0.3% +4.0% +16.4% ➖ noise
43 datafusion:vortex-compact +3.6% -0.8% +4.5% +10.0% ➖ noise
43 datafusion:vortex-file-compressed -1.1% -0.8% -0.3% +10.0% ➖ noise
43 duckdb:duckdb +15.3% -0.8% +16.2% +10.0% 🚨 regression
43 duckdb:vortex-compact +2.2% -0.8% +3.0% +11.9% ➖ noise
43 duckdb:vortex-file-compressed -7.1% -0.8% -6.4% +11.6% ➖ noise
44 datafusion:vortex-compact -0.4% -0.7% +0.3% +12.1% ➖ noise
44 datafusion:vortex-file-compressed +3.3% -0.7% +4.0% +11.9% ➖ noise
44 duckdb:duckdb +7.7% -0.7% +8.4% +17.4% ➖ noise
44 duckdb:vortex-compact -1.9% -0.7% -1.2% +14.6% ➖ noise
44 duckdb:vortex-file-compressed +0.8% -0.7% +1.4% +11.0% ➖ noise
45 datafusion:vortex-compact -2.9% -0.8% -2.2% +10.0% ➖ noise
45 datafusion:vortex-file-compressed -0.2% -0.8% +0.6% +11.6% ➖ noise
45 duckdb:duckdb +24.7% -0.8% +25.7% +10.0% 🚨 regression
45 duckdb:vortex-compact -4.2% -0.8% -3.4% +11.6% ➖ noise
45 duckdb:vortex-file-compressed -3.0% -0.8% -2.2% +12.0% ➖ noise
46 datafusion:vortex-compact -2.5% -3.3% +0.8% +20.3% ➖ noise
46 datafusion:vortex-file-compressed +4.7% -3.3% +8.3% +12.7% ➖ noise
46 duckdb:duckdb +17.0% -3.3% +21.0% +10.0% 🚨 regression
46 duckdb:vortex-compact -5.3% -3.3% -2.0% +14.8% ➖ noise
46 duckdb:vortex-file-compressed -1.6% -3.3% +1.8% +15.7% ➖ noise
47 datafusion:vortex-compact +0.6% +0.2% +0.4% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +0.2% +0.2% +0.0% +10.0% ➖ noise
47 duckdb:duckdb +23.7% +0.2% +23.5% +10.0% 🚨 regression
47 duckdb:vortex-compact -0.2% +0.2% -0.4% +10.0% ➖ noise
47 duckdb:vortex-file-compressed -0.4% +0.2% -0.6% +10.0% ➖ noise
48 datafusion:vortex-compact +3.1% +0.9% +2.1% +14.2% ➖ noise
48 datafusion:vortex-file-compressed +2.7% +0.9% +1.7% +10.0% ➖ noise
48 duckdb:duckdb +6.1% +0.9% +5.1% +10.0% ➖ noise
48 duckdb:vortex-compact -0.6% +0.9% -1.5% +10.0% ➖ noise
48 duckdb:vortex-file-compressed +1.7% +0.9% +0.7% +10.0% ➖ noise
49 datafusion:vortex-compact +2.8% +2.3% +0.5% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +3.5% +2.3% +1.2% +10.0% ➖ noise
49 duckdb:duckdb +23.3% +2.3% +20.5% +15.4% 🚨 regression
49 duckdb:vortex-compact -8.2% +2.3% -10.2% +13.1% ➖ noise
49 duckdb:vortex-file-compressed -1.0% +2.3% -3.2% +27.2% ➖ noise
50 datafusion:vortex-compact +2.0% +1.0% +1.0% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +0.5% +1.0% -0.5% +10.0% ➖ noise
50 duckdb:duckdb +16.4% +1.0% +15.3% +10.0% 🚨 regression
50 duckdb:vortex-compact -1.3% +1.0% -2.3% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -6.7% +1.0% -7.7% +10.0% ➖ noise
51 datafusion:vortex-compact -4.5% +3.0% -7.2% +10.0% ➖ noise
51 datafusion:vortex-file-compressed -0.2% +3.0% -3.1% +10.0% ➖ noise
51 duckdb:duckdb +14.9% +3.0% +11.5% +18.9% ➖ noise
51 duckdb:vortex-compact +3.6% +3.0% +0.6% +16.6% ➖ noise
51 duckdb:vortex-file-compressed -3.7% +3.0% -6.5% +14.7% ➖ noise
52 datafusion:vortex-compact +1.0% +1.9% -0.9% +14.2% ➖ noise
52 datafusion:vortex-file-compressed +13.4% +1.9% +11.3% +17.3% ➖ noise
52 duckdb:duckdb +14.4% +1.9% +12.4% +35.6% ➖ noise
52 duckdb:vortex-compact +3.3% +1.9% +1.5% +10.0% ➖ noise
52 duckdb:vortex-file-compressed -15.7% +1.9% -17.3% +34.2% ➖ noise
53 datafusion:vortex-compact -3.6% -3.7% +0.2% +15.9% ➖ noise
53 datafusion:vortex-file-compressed -3.9% -3.7% -0.1% +12.5% ➖ noise
53 duckdb:duckdb +10.8% -3.7% +15.1% +11.5% 🚨 regression
53 duckdb:vortex-compact +0.4% -3.7% +4.3% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +8.7% -3.7% +12.9% +12.4% 🚨 regression
54 datafusion:vortex-compact -3.0% +0.9% -3.8% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +1.3% +0.9% +0.4% +10.2% ➖ noise
54 duckdb:duckdb +20.5% +0.9% +19.4% +10.0% 🚨 regression
54 duckdb:vortex-compact -5.1% +0.9% -6.0% +12.6% ➖ noise
54 duckdb:vortex-file-compressed -1.5% +0.9% -2.4% +10.0% ➖ noise
55 datafusion:vortex-compact +4.2% -2.0% +6.3% +11.9% ➖ noise
55 datafusion:vortex-file-compressed -5.4% -2.0% -3.5% +10.5% ➖ noise
55 duckdb:duckdb +23.8% -2.0% +26.3% +18.6% 🚨 regression
55 duckdb:vortex-compact -5.5% -2.0% -3.6% +22.2% ➖ noise
55 duckdb:vortex-file-compressed -2.2% -2.0% -0.1% +12.6% ➖ noise
56 datafusion:vortex-compact +1.8% +0.2% +1.5% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +3.3% +0.2% +3.1% +10.0% ➖ noise
56 duckdb:duckdb +19.0% +0.2% +18.7% +10.0% 🚨 regression
56 duckdb:vortex-compact +1.8% +0.2% +1.5% +10.4% ➖ noise
56 duckdb:vortex-file-compressed -0.7% +0.2% -0.9% +10.0% ➖ noise
57 datafusion:vortex-compact +0.7% -8.1% +9.6% +13.2% ➖ noise
57 datafusion:vortex-file-compressed -0.0% -8.1% +8.8% +13.2% ➖ noise
57 duckdb:duckdb +7.1% -8.1% +16.5% +19.6% ➖ noise
57 duckdb:vortex-compact -2.7% -8.1% +5.9% +12.4% ➖ noise
57 duckdb:vortex-file-compressed -3.3% -8.1% +5.2% +12.6% ➖ noise
58 datafusion:vortex-compact -8.8% -0.6% -8.3% +10.0% ➖ noise
58 datafusion:vortex-file-compressed -1.9% -0.6% -1.3% +10.0% ➖ noise
58 duckdb:duckdb +6.5% -0.6% +7.2% +12.8% ➖ noise
58 duckdb:vortex-compact +2.0% -0.6% +2.6% +13.5% ➖ noise
58 duckdb:vortex-file-compressed -3.3% -0.6% -2.8% +10.4% ➖ noise
59 datafusion:vortex-compact +3.2% +0.1% +3.1% +10.0% ➖ noise
59 datafusion:vortex-file-compressed -2.0% +0.1% -2.1% +10.0% ➖ noise
59 duckdb:duckdb +12.8% +0.1% +12.7% +10.0% 🚨 regression
59 duckdb:vortex-compact +2.2% +0.1% +2.1% +15.7% ➖ noise
59 duckdb:vortex-file-compressed -0.9% +0.1% -1.0% +10.0% ➖ noise
60 datafusion:vortex-compact +6.3% +1.4% +4.9% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +0.6% +1.4% -0.8% +10.2% ➖ noise
60 duckdb:duckdb +13.8% +1.4% +12.2% +10.0% 🚨 regression
60 duckdb:vortex-compact -1.6% +1.4% -2.9% +14.5% ➖ noise
60 duckdb:vortex-file-compressed +2.9% +1.4% +1.5% +10.0% ➖ noise
61 datafusion:vortex-compact +1.0% -0.3% +1.2% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +1.3% -0.3% +1.5% +10.0% ➖ noise
61 duckdb:duckdb +22.7% -0.3% +23.0% +10.0% 🚨 regression
61 duckdb:vortex-compact +0.4% -0.3% +0.7% +10.0% ➖ noise
61 duckdb:vortex-file-compressed -0.6% -0.3% -0.3% +20.6% ➖ noise
62 datafusion:vortex-compact +11.3% +2.7% +8.5% +29.0% ➖ noise
62 datafusion:vortex-file-compressed +0.9% +2.7% -1.7% +24.2% ➖ noise
62 duckdb:duckdb +14.0% +2.7% +11.1% +25.3% ➖ noise
62 duckdb:vortex-compact +7.5% +2.7% +4.7% +21.4% ➖ noise
62 duckdb:vortex-file-compressed +0.7% +2.7% -1.9% +26.2% ➖ noise
63 datafusion:vortex-compact -1.5% -2.3% +0.8% +10.0% ➖ noise
63 datafusion:vortex-file-compressed -0.5% -2.3% +1.9% +10.9% ➖ noise
63 duckdb:duckdb +13.5% -2.3% +16.2% +10.0% 🚨 regression
63 duckdb:vortex-compact -2.2% -2.3% +0.1% +10.0% ➖ noise
63 duckdb:vortex-file-compressed +0.3% -2.3% +2.7% +10.0% ➖ noise
64 datafusion:vortex-compact -0.5% -0.7% +0.2% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +0.5% -0.7% +1.2% +10.0% ➖ noise
64 duckdb:duckdb +11.1% -0.7% +11.9% +10.0% 🚨 regression
64 duckdb:vortex-compact +6.4% -0.7% +7.1% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +0.9% -0.7% +1.6% +10.0% ➖ noise
65 datafusion:vortex-compact +2.9% -1.6% +4.5% +17.1% ➖ noise
65 datafusion:vortex-file-compressed +0.7% -1.6% +2.3% +10.0% ➖ noise
65 duckdb:duckdb +8.9% -1.6% +10.6% +15.6% ➖ noise
65 duckdb:vortex-compact +6.5% -1.6% +8.2% +10.0% ➖ noise
65 duckdb:vortex-file-compressed +1.0% -1.6% +2.6% +10.0% ➖ noise
66 datafusion:vortex-compact +1.8% +0.3% +1.5% +10.0% ➖ noise
66 datafusion:vortex-file-compressed -3.9% +0.3% -4.1% +12.0% ➖ noise
66 duckdb:duckdb +9.3% +0.3% +9.0% +12.6% ➖ noise
66 duckdb:vortex-compact +15.6% +0.3% +15.3% +19.7% ➖ noise
66 duckdb:vortex-file-compressed -9.8% +0.3% -10.0% +20.0% ➖ noise
67 datafusion:vortex-compact +1.6% -0.3% +2.0% +11.1% ➖ noise
67 datafusion:vortex-file-compressed -0.3% -0.3% -0.0% +10.0% ➖ noise
67 duckdb:duckdb +14.5% -0.3% +14.8% +10.0% 🚨 regression
67 duckdb:vortex-compact +16.6% -0.3% +17.0% +10.0% 🚨 regression
67 duckdb:vortex-file-compressed -0.2% -0.3% +0.1% +10.0% ➖ noise
68 datafusion:vortex-compact -0.7% -1.3% +0.5% +10.0% ➖ noise
68 datafusion:vortex-file-compressed -0.4% -1.3% +0.9% +10.0% ➖ noise
68 duckdb:duckdb +11.6% -1.3% +13.1% +10.0% 🚨 regression
68 duckdb:vortex-compact +10.9% -1.3% +12.3% +15.1% ➖ noise
68 duckdb:vortex-file-compressed -1.0% -1.3% +0.3% +11.4% ➖ noise
69 datafusion:vortex-compact -0.8% +0.2% -1.0% +10.0% ➖ noise
69 datafusion:vortex-file-compressed -1.4% +0.2% -1.6% +10.0% ➖ noise
69 duckdb:duckdb +15.4% +0.2% +15.1% +21.0% ➖ noise
69 duckdb:vortex-compact +12.4% +0.2% +12.2% +10.0% 🚨 regression
69 duckdb:vortex-file-compressed -5.9% +0.2% -6.1% +12.1% ➖ noise
70 datafusion:vortex-compact -3.3% +1.3% -4.6% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +1.0% +1.3% -0.2% +11.9% ➖ noise
70 duckdb:duckdb +19.0% +1.3% +17.5% +12.1% 🚨 regression
70 duckdb:vortex-compact +5.2% +1.3% +3.9% +10.6% ➖ noise
70 duckdb:vortex-file-compressed +2.0% +1.3% +0.7% +16.0% ➖ noise
71 datafusion:vortex-compact +0.4% -0.3% +0.6% +10.0% ➖ noise
71 datafusion:vortex-file-compressed -4.5% -0.3% -4.2% +10.1% ➖ noise
71 duckdb:duckdb +15.7% -0.3% +16.0% +12.0% 🚨 regression
71 duckdb:vortex-compact +11.2% -0.3% +11.5% +10.0% 🚨 regression
71 duckdb:vortex-file-compressed -1.1% -0.3% -0.8% +10.0% ➖ noise
72 datafusion:vortex-compact +4.1% +0.0% +4.1% +10.0% ➖ noise
72 datafusion:vortex-file-compressed -0.0% +0.0% -0.0% +10.0% ➖ noise
72 duckdb:duckdb +10.7% +0.0% +10.6% +10.0% 🚨 regression
72 duckdb:vortex-compact +9.1% +0.0% +9.1% +10.0% ➖ noise
72 duckdb:vortex-file-compressed -0.2% +0.0% -0.2% +10.0% ➖ noise
73 datafusion:vortex-compact +4.7% +1.0% +3.7% +17.3% ➖ noise
73 datafusion:vortex-file-compressed +3.4% +1.0% +2.3% +10.0% ➖ noise
73 duckdb:duckdb +12.4% +1.0% +11.3% +12.8% ➖ noise
73 duckdb:vortex-compact +15.8% +1.0% +14.6% +18.1% ➖ noise
73 duckdb:vortex-file-compressed +0.8% +1.0% -0.2% +10.9% ➖ noise
74 datafusion:vortex-compact -0.6% -1.7% +1.2% +12.1% ➖ noise
74 datafusion:vortex-file-compressed -1.0% -1.7% +0.7% +10.0% ➖ noise
74 duckdb:duckdb +9.4% -1.7% +11.3% +10.0% 🚨 regression
74 duckdb:vortex-compact +6.2% -1.7% +8.0% +11.7% ➖ noise
74 duckdb:vortex-file-compressed -2.4% -1.7% -0.8% +10.0% ➖ noise
75 datafusion:vortex-compact +1.6% -1.7% +3.4% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +2.1% -1.7% +3.9% +11.7% ➖ noise
75 duckdb:duckdb +12.6% -1.7% +14.6% +10.1% 🚨 regression
75 duckdb:vortex-compact +20.2% -1.7% +22.4% +10.0% 🚨 regression
75 duckdb:vortex-file-compressed -1.6% -1.7% +0.1% +18.7% ➖ noise
76 datafusion:vortex-compact +3.7% +0.4% +3.3% +10.0% ➖ noise
76 datafusion:vortex-file-compressed -1.6% +0.4% -2.0% +10.4% ➖ noise
76 duckdb:duckdb +6.5% +0.4% +6.1% +13.2% ➖ noise
76 duckdb:vortex-compact +4.4% +0.4% +3.9% +10.2% ➖ noise
76 duckdb:vortex-file-compressed +0.6% +0.4% +0.2% +14.5% ➖ noise
77 datafusion:vortex-compact +5.9% -0.7% +6.7% +17.8% ➖ noise
77 datafusion:vortex-file-compressed -2.4% -0.7% -1.7% +11.7% ➖ noise
77 duckdb:duckdb +10.2% -0.7% +11.0% +17.6% ➖ noise
77 duckdb:vortex-compact +8.1% -0.7% +8.8% +16.1% ➖ noise
77 duckdb:vortex-file-compressed -4.8% -0.7% -4.1% +12.4% ➖ noise
78 datafusion:vortex-compact +8.4% -1.0% +9.5% +10.0% ➖ noise
78 datafusion:vortex-file-compressed -1.9% -1.0% -0.9% +10.0% ➖ noise
78 duckdb:duckdb +16.1% -1.0% +17.3% +10.0% 🚨 regression
78 duckdb:vortex-compact +8.9% -1.0% +10.0% +10.0% 🚨 regression
78 duckdb:vortex-file-compressed -3.0% -1.0% -2.0% +10.0% ➖ noise
79 datafusion:vortex-compact +2.0% +0.9% +1.1% +10.0% ➖ noise
79 datafusion:vortex-file-compressed -2.1% +0.9% -3.0% +10.0% ➖ noise
79 duckdb:duckdb +14.1% +0.9% +13.1% +10.0% 🚨 regression
79 duckdb:vortex-compact +11.8% +0.9% +10.8% +10.5% 🚨 regression
79 duckdb:vortex-file-compressed +0.8% +0.9% -0.1% +10.0% ➖ noise
80 datafusion:vortex-compact -0.1% +1.5% -1.6% +10.4% ➖ noise
80 datafusion:vortex-file-compressed -3.0% +1.5% -4.5% +10.0% ➖ noise
80 duckdb:duckdb +11.4% +1.5% +9.7% +10.0% ➖ noise
80 duckdb:vortex-compact +5.4% +1.5% +3.8% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -0.5% +1.5% -2.0% +16.6% ➖ noise
81 datafusion:vortex-compact +4.7% +2.5% +2.2% +14.6% ➖ noise
81 datafusion:vortex-file-compressed +12.2% +2.5% +9.5% +12.0% ➖ noise
81 duckdb:duckdb +11.5% +2.5% +8.8% +12.8% ➖ noise
81 duckdb:vortex-compact +15.2% +2.5% +12.4% +12.0% 🚨 regression
81 duckdb:vortex-file-compressed +1.1% +2.5% -1.4% +11.8% ➖ noise
82 datafusion:vortex-compact +2.7% +3.2% -0.4% +10.0% ➖ noise
82 datafusion:vortex-file-compressed +2.3% +3.2% -0.8% +20.2% ➖ noise
82 duckdb:duckdb +23.4% +3.2% +19.6% +10.0% 🚨 regression
82 duckdb:vortex-compact +7.6% +3.2% +4.3% +11.9% ➖ noise
82 duckdb:vortex-file-compressed +1.6% +3.2% -1.5% +12.6% ➖ noise
83 datafusion:vortex-compact +3.6% -6.3% +10.5% +10.0% 🚨 regression
83 datafusion:vortex-file-compressed -6.3% -6.3% -0.0% +10.0% ➖ noise
83 duckdb:duckdb +28.0% -6.3% +36.6% +10.4% 🚨 regression
83 duckdb:vortex-compact +21.8% -6.3% +30.0% +11.5% 🚨 regression
83 duckdb:vortex-file-compressed -1.3% -6.3% +5.3% +10.0% ➖ noise
84 datafusion:vortex-compact +1.8% +2.8% -1.0% +10.0% ➖ noise
84 datafusion:vortex-file-compressed -1.8% +2.8% -4.5% +10.0% ➖ noise
84 duckdb:duckdb +21.7% +2.8% +18.3% +19.9% ➖ noise
84 duckdb:vortex-compact +15.3% +2.8% +12.2% +10.0% 🚨 regression
84 duckdb:vortex-file-compressed -1.7% +2.8% -4.4% +10.0% ➖ noise
85 datafusion:vortex-compact +3.7% +1.6% +2.1% +15.5% ➖ noise
85 datafusion:vortex-file-compressed -2.9% +1.6% -4.4% +10.0% ➖ noise
85 duckdb:duckdb +27.8% +1.6% +25.8% +13.4% 🚨 regression
85 duckdb:vortex-compact +2.2% +1.6% +0.6% +10.0% ➖ noise
85 duckdb:vortex-file-compressed -7.9% +1.6% -9.3% +10.0% ✅ faster
86 datafusion:vortex-compact -0.8% +0.5% -1.3% +19.9% ➖ noise
86 datafusion:vortex-file-compressed -2.7% +0.5% -3.2% +21.3% ➖ noise
86 duckdb:duckdb +16.9% +0.5% +16.2% +13.7% 🚨 regression
86 duckdb:vortex-compact +21.4% +0.5% +20.7% +14.2% 🚨 regression
86 duckdb:vortex-file-compressed -8.6% +0.5% -9.1% +11.7% ➖ noise
87 datafusion:vortex-compact +3.8% +0.4% +3.4% +11.7% ➖ noise
87 datafusion:vortex-file-compressed +0.9% +0.4% +0.5% +10.0% ➖ noise
87 duckdb:duckdb +18.1% +0.4% +17.5% +10.0% 🚨 regression
87 duckdb:vortex-compact -1.4% +0.4% -1.8% +11.2% ➖ noise
87 duckdb:vortex-file-compressed +1.3% +0.4% +0.9% +10.7% ➖ noise
88 datafusion:vortex-compact -0.2% -1.3% +1.0% +10.0% ➖ noise
88 datafusion:vortex-file-compressed -2.1% -1.3% -0.9% +10.0% ➖ noise
88 duckdb:duckdb +13.0% -1.3% +14.5% +10.0% 🚨 regression
88 duckdb:vortex-compact +0.9% -1.3% +2.2% +10.0% ➖ noise
88 duckdb:vortex-file-compressed -0.1% -1.3% +1.2% +10.0% ➖ noise
89 datafusion:vortex-compact +3.0% +0.5% +2.4% +10.0% ➖ noise
89 datafusion:vortex-file-compressed -2.5% +0.5% -3.0% +10.0% ➖ noise
89 duckdb:duckdb +16.1% +0.5% +15.4% +11.4% 🚨 regression
89 duckdb:vortex-compact +1.3% +0.5% +0.8% +16.4% ➖ noise
89 duckdb:vortex-file-compressed -2.3% +0.5% -2.8% +21.4% ➖ noise
90 datafusion:vortex-compact +3.3% +3.0% +0.2% +14.5% ➖ noise
90 datafusion:vortex-file-compressed +1.8% +3.0% -1.2% +16.2% ➖ noise
90 duckdb:duckdb +23.6% +3.0% +19.9% +10.0% 🚨 regression
90 duckdb:vortex-compact +3.0% +3.0% -0.1% +13.4% ➖ noise
90 duckdb:vortex-file-compressed -1.3% +3.0% -4.2% +12.1% ➖ noise
91 datafusion:vortex-compact +1.7% -1.1% +2.8% +10.0% ➖ noise
91 datafusion:vortex-file-compressed -3.3% -1.1% -2.2% +10.0% ➖ noise
91 duckdb:duckdb +25.5% -1.1% +26.9% +12.7% 🚨 regression
91 duckdb:vortex-compact +3.7% -1.1% +4.9% +10.0% ➖ noise
91 duckdb:vortex-file-compressed -7.7% -1.1% -6.6% +15.1% ➖ noise
92 datafusion:vortex-compact +8.9% -2.0% +11.1% +13.7% ➖ noise
92 datafusion:vortex-file-compressed -0.6% -2.0% +1.4% +10.0% ➖ noise
92 duckdb:duckdb +13.1% -2.0% +15.4% +22.8% ➖ noise
92 duckdb:vortex-compact -9.3% -2.0% -7.5% +21.1% ➖ noise
92 duckdb:vortex-file-compressed +6.7% -2.0% +8.8% +19.3% ➖ noise
93 datafusion:vortex-compact +1.7% -2.9% +4.8% +11.6% ➖ noise
93 datafusion:vortex-file-compressed +3.2% -2.9% +6.3% +19.0% ➖ noise
93 duckdb:duckdb +12.3% -2.9% +15.7% +13.5% 🚨 regression
93 duckdb:vortex-compact +2.2% -2.9% +5.3% +14.4% ➖ noise
93 duckdb:vortex-file-compressed +2.8% -2.9% +5.8% +11.6% ➖ noise
94 datafusion:vortex-compact +2.3% -3.2% +5.7% +11.2% ➖ noise
94 datafusion:vortex-file-compressed +1.8% -3.2% +5.1% +10.0% ➖ noise
94 duckdb:duckdb +18.1% -3.2% +22.0% +10.0% 🚨 regression
94 duckdb:vortex-compact +6.6% -3.2% +10.1% +10.0% 🚨 regression
94 duckdb:vortex-file-compressed +1.3% -3.2% +4.6% +10.0% ➖ noise
95 datafusion:vortex-compact +4.1% +1.4% +2.7% +10.3% ➖ noise
95 datafusion:vortex-file-compressed -2.1% +1.4% -3.4% +10.0% ➖ noise
95 duckdb:duckdb +4.5% +1.4% +3.1% +17.7% ➖ noise
95 duckdb:vortex-compact -0.4% +1.4% -1.7% +15.9% ➖ noise
95 duckdb:vortex-file-compressed +0.3% +1.4% -1.1% +25.4% ➖ noise
96 datafusion:vortex-compact -0.5% -6.0% +5.8% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +0.0% -6.0% +6.4% +10.0% ➖ noise
96 duckdb:duckdb +15.5% -6.0% +22.9% +14.4% 🚨 regression
96 duckdb:vortex-compact +4.5% -6.0% +11.1% +12.4% ➖ noise
96 duckdb:vortex-file-compressed -8.3% -6.0% -2.5% +12.5% ➖ noise
97 datafusion:vortex-compact -1.3% -2.0% +0.7% +10.0% ➖ noise
97 datafusion:vortex-file-compressed +5.8% -2.0% +7.9% +10.0% ➖ noise
97 duckdb:duckdb +19.0% -2.0% +21.4% +10.5% 🚨 regression
97 duckdb:vortex-compact +8.7% -2.0% +10.9% +11.7% ➖ noise
97 duckdb:vortex-file-compressed -5.5% -2.0% -3.5% +14.7% ➖ noise
98 datafusion:vortex-compact +1.5% +1.9% -0.4% +11.4% ➖ noise
98 datafusion:vortex-file-compressed -1.1% +1.9% -3.0% +10.0% ➖ noise
98 duckdb:duckdb +10.0% +1.9% +7.9% +14.0% ➖ noise
98 duckdb:vortex-compact +12.9% +1.9% +10.7% +10.0% 🚨 regression
98 duckdb:vortex-file-compressed +0.5% +1.9% -1.3% +15.9% ➖ noise
99 datafusion:vortex-compact -1.9% -2.2% +0.3% +21.4% ➖ noise
99 datafusion:vortex-file-compressed +15.8% -2.2% +18.5% +20.7% ➖ noise
99 duckdb:duckdb +14.7% -2.2% +17.4% +13.3% 🚨 regression
99 duckdb:vortex-compact +4.3% -2.2% +6.7% +17.9% ➖ noise
99 duckdb:vortex-file-compressed +2.7% -2.2% +5.0% +15.6% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.2%
Vortex (geomean): 0.995x ➖
Parquet (geomean): 1.017x ➖
Shifts: Parquet (control) +1.7% · Median polish +1.7%

datafusion / vortex-file-compressed (1.149x ➖, 0↑ 2↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 36015172 28276641 1.27
fineweb_q01/datafusion:vortex-file-compressed 🚨 1166137674 726347041 1.61
fineweb_q02/datafusion:vortex-file-compressed 🚨 807865614 514759681 1.57
fineweb_q03/datafusion:vortex-file-compressed 1716839866 1449077610 1.18
fineweb_q04/datafusion:vortex-file-compressed 1418254508 1401987327 1.01
fineweb_q05/datafusion:vortex-file-compressed 1334788492 1386677938 0.96
fineweb_q06/datafusion:vortex-file-compressed 1503365018 1516233779 0.99
fineweb_q07/datafusion:vortex-file-compressed 1368325429 1365477390 1.00
fineweb_q08/datafusion:vortex-file-compressed 515051725 542399898 0.95
datafusion / vortex-compact (0.797x ➖, 2↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 33000779 58600399 0.56
fineweb_q01/datafusion:vortex-compact 650765307 773379019 0.84
fineweb_q02/datafusion:vortex-compact 🚀 510407258 772506538 0.66
fineweb_q03/datafusion:vortex-compact 1290212664 1399157526 0.92
fineweb_q04/datafusion:vortex-compact 1515249235 1634589988 0.93
fineweb_q05/datafusion:vortex-compact 1357202717 1413694512 0.96
fineweb_q06/datafusion:vortex-compact 1326315468 1718460871 0.77
fineweb_q07/datafusion:vortex-compact 1152404475 1354788279 0.85
fineweb_q08/datafusion:vortex-compact 351561189 459384867 0.77
datafusion / parquet (1.005x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 1831751489 1478605185 1.24
fineweb_q01/datafusion:parquet 1877979241 1893037354 0.99
fineweb_q02/datafusion:parquet 1956386502 1841589624 1.06
fineweb_q03/datafusion:parquet 1830421126 2003957284 0.91
fineweb_q04/datafusion:parquet 1783018797 1942674261 0.92
fineweb_q05/datafusion:parquet 2027169432 1971600689 1.03
fineweb_q06/datafusion:parquet 1976053483 2239527546 0.88
fineweb_q07/datafusion:parquet 1886343211 1964990610 0.96
fineweb_q08/datafusion:parquet 2124109973 1937634732 1.10
duckdb / vortex-file-compressed (1.012x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 94493269 98288466 0.96
fineweb_q01/duckdb:vortex-file-compressed 842480784 836010223 1.01
fineweb_q02/duckdb:vortex-file-compressed 477532503 519990337 0.92
fineweb_q03/duckdb:vortex-file-compressed 1507911160 1477489604 1.02
fineweb_q04/duckdb:vortex-file-compressed 1592750163 1477233727 1.08
fineweb_q05/duckdb:vortex-file-compressed 1499101613 1485142727 1.01
fineweb_q06/duckdb:vortex-file-compressed 1793760150 1590507961 1.13
fineweb_q07/duckdb:vortex-file-compressed 1472442287 1491556845 0.99
fineweb_q08/duckdb:vortex-file-compressed 645692601 637296084 1.01
duckdb / vortex-compact (1.057x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 93809045 82272841 1.14
fineweb_q01/duckdb:vortex-compact 605504234 601385285 1.01
fineweb_q02/duckdb:vortex-compact 637000072 572801415 1.11
fineweb_q03/duckdb:vortex-compact 1774375785 1677216059 1.06
fineweb_q04/duckdb:vortex-compact 1747680297 1751178804 1.00
fineweb_q05/duckdb:vortex-compact 1559112198 1582865958 0.98
fineweb_q06/duckdb:vortex-compact 1471079774 1442767304 1.02
fineweb_q07/duckdb:vortex-compact 1397278695 1422941051 0.98
fineweb_q08/duckdb:vortex-compact 582582677 469602857 1.24
duckdb / parquet (1.030x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1258045392 1166502776 1.08
fineweb_q01/duckdb:parquet 1513078486 1388243139 1.09
fineweb_q02/duckdb:parquet 1495099466 1523152624 0.98
fineweb_q03/duckdb:parquet 3854513623 3916671462 0.98
fineweb_q04/duckdb:parquet 2094013638 1958975332 1.07
fineweb_q05/duckdb:parquet 2377302921 2219580202 1.07
fineweb_q06/duckdb:parquet 4713164049 4353328263 1.08
fineweb_q07/duckdb:parquet 2589031261 2742597061 0.94
fineweb_q08/duckdb:parquet 1159178922 1185025298 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -43.7% +15.6% -51.3% +220.4% ➖ noise
0 datafusion:vortex-file-compressed +27.4% +15.6% +10.2% +182.1% ➖ noise
0 duckdb:vortex-compact +14.0% +15.6% -1.4% +36.3% ➖ noise
0 duckdb:vortex-file-compressed -3.9% +15.6% -16.8% +45.5% ➖ noise
1 datafusion:vortex-compact -15.9% +4.0% -19.1% +80.3% ➖ noise
1 datafusion:vortex-file-compressed +60.5% +4.0% +54.4% +55.8% ➖ noise
1 duckdb:vortex-compact +0.7% +4.0% -3.2% +30.0% ➖ noise
1 duckdb:vortex-file-compressed +0.8% +4.0% -3.1% +51.5% ➖ noise
2 datafusion:vortex-compact -33.9% +2.1% -35.3% +30.0% ✅ faster
2 datafusion:vortex-file-compressed +56.9% +2.1% +53.7% +54.8% ➖ noise
2 duckdb:vortex-compact +11.2% +2.1% +8.9% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -8.2% +2.1% -10.1% +30.0% ➖ noise
3 datafusion:vortex-compact -7.8% -5.2% -2.7% +30.0% ➖ noise
3 datafusion:vortex-file-compressed +18.5% -5.2% +25.0% +30.0% ➖ noise
3 duckdb:vortex-compact +5.8% -5.2% +11.6% +30.0% ➖ noise
3 duckdb:vortex-file-compressed +2.1% -5.2% +7.6% +46.8% ➖ noise
4 datafusion:vortex-compact -7.3% -1.0% -6.4% +30.0% ➖ noise
4 datafusion:vortex-file-compressed +1.2% -1.0% +2.1% +30.0% ➖ noise
4 duckdb:vortex-compact -0.2% -1.0% +0.8% +30.0% ➖ noise
4 duckdb:vortex-file-compressed +7.8% -1.0% +8.9% +30.0% ➖ noise
5 datafusion:vortex-compact -4.0% +4.9% -8.5% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -3.7% +4.9% -8.3% +30.0% ➖ noise
5 duckdb:vortex-compact -1.5% +4.9% -6.1% +30.0% ➖ noise
5 duckdb:vortex-file-compressed +0.9% +4.9% -3.8% +30.0% ➖ noise
6 datafusion:vortex-compact -22.8% -2.3% -21.0% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -0.8% -2.3% +1.4% +30.0% ➖ noise
6 duckdb:vortex-compact +2.0% -2.3% +4.3% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +12.8% -2.3% +15.4% +30.0% ➖ noise
7 datafusion:vortex-compact -14.9% -4.8% -10.6% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +0.2% -4.8% +5.3% +30.0% ➖ noise
7 duckdb:vortex-compact -1.8% -4.8% +3.2% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -1.3% -4.8% +3.7% +30.0% ➖ noise
8 datafusion:vortex-compact -23.5% +3.6% -26.1% +30.0% ✅ faster
8 datafusion:vortex-file-compressed -5.0% +3.6% -8.3% +30.0% ➖ noise
8 duckdb:vortex-compact +24.1% +3.6% +19.8% +34.2% ➖ noise
8 duckdb:vortex-file-compressed +1.3% +3.6% -2.2% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.7%
Vortex (geomean): 1.012x ➖
Parquet (geomean): 1.019x ➖
Shifts: Parquet (control) +1.9% · Median polish +1.7%

duckdb / vortex-file-compressed (1.011x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 12005210 11979979 1.00
statpopgen_q01/duckdb:vortex-file-compressed 26185564 27311577 0.96
statpopgen_q02/duckdb:vortex-file-compressed 544166800 552409980 0.99
statpopgen_q03/duckdb:vortex-file-compressed 2274652193 2268273287 1.00
statpopgen_q04/duckdb:vortex-file-compressed 2320018359 2327817604 1.00
statpopgen_q05/duckdb:vortex-file-compressed 508247788 483009649 1.05
statpopgen_q06/duckdb:vortex-file-compressed 1565108411 1535582359 1.02
statpopgen_q07/duckdb:vortex-file-compressed 214544893 210560772 1.02
statpopgen_q08/duckdb:vortex-file-compressed 254505130 244776292 1.04
statpopgen_q09/duckdb:vortex-file-compressed 2104922973 2055512009 1.02
statpopgen_q10/duckdb:vortex-file-compressed 4257197467 4157083219 1.02
duckdb / vortex-compact (1.012x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11815641 11409249 1.04
statpopgen_q01/duckdb:vortex-compact 214421043 216035666 0.99
statpopgen_q02/duckdb:vortex-compact 555020507 559962333 0.99
statpopgen_q03/duckdb:vortex-compact 2247055623 2242916736 1.00
statpopgen_q04/duckdb:vortex-compact 2314188363 2260684239 1.02
statpopgen_q05/duckdb:vortex-compact 579352722 561701157 1.03
statpopgen_q06/duckdb:vortex-compact 1512864276 1487436695 1.02
statpopgen_q07/duckdb:vortex-compact 895913738 896314898 1.00
statpopgen_q08/duckdb:vortex-compact 924233309 919980108 1.00
statpopgen_q09/duckdb:vortex-compact 2055571593 2018626806 1.02
statpopgen_q10/duckdb:vortex-compact 4258047290 4179774932 1.02
duckdb / parquet (1.019x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 333725663 324183121 1.03
statpopgen_q01/duckdb:parquet 420152276 401109352 1.05
statpopgen_q02/duckdb:parquet 1008448619 995624783 1.01
statpopgen_q03/duckdb:parquet 1533939856 1482848583 1.03
statpopgen_q04/duckdb:parquet 1550582511 1515130528 1.02
statpopgen_q05/duckdb:parquet 1028761030 1021163510 1.01
statpopgen_q06/duckdb:parquet 1506533806 1496663746 1.01
statpopgen_q07/duckdb:parquet 1326074005 1309214269 1.01
statpopgen_q08/duckdb:parquet 1316616878 1315258859 1.00
statpopgen_q09/duckdb:parquet 1386049844 1370408367 1.01
statpopgen_q10/duckdb:parquet 2716899563 2666858030 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact +3.6% +2.9% +0.6% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +0.2% +2.9% -2.7% +10.0% ➖ noise
1 duckdb:vortex-compact -0.7% +4.7% -5.2% +11.1% ➖ noise
1 duckdb:vortex-file-compressed -4.1% +4.7% -8.5% +220.1% ➖ noise
2 duckdb:vortex-compact -0.9% +1.3% -2.1% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -1.5% +1.3% -2.7% +10.0% ➖ noise
3 duckdb:vortex-compact +0.2% +3.4% -3.2% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.3% +3.4% -3.1% +10.0% ➖ noise
4 duckdb:vortex-compact +2.4% +2.3% +0.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -0.3% +2.3% -2.6% +10.0% ➖ noise
5 duckdb:vortex-compact +3.1% +0.7% +2.4% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +5.2% +0.7% +4.4% +10.0% ➖ noise
6 duckdb:vortex-compact +1.7% +0.7% +1.0% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.9% +0.7% +1.3% +10.0% ➖ noise
7 duckdb:vortex-compact -0.0% +1.3% -1.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +1.9% +1.3% +0.6% +10.0% ➖ noise
8 duckdb:vortex-compact +0.5% +0.1% +0.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +4.0% +0.1% +3.9% +10.0% ➖ noise
9 duckdb:vortex-compact +1.8% +1.1% +0.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +2.4% +1.1% +1.2% +10.0% ➖ noise
10 duckdb:vortex-compact +1.9% +1.9% -0.0% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.4% +1.9% +0.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Benchmarks: Random Access

Vortex (geomean): 0.836x ✅
Parquet (geomean): 0.918x ➖

unknown / unknown (0.877x ✅, 20↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚀 371239 1905158 0.19
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1043106 1057351 0.99
random-access/feature-vectors/correlated/parquet-tokio-local-disk 8040083315 8679214819 0.93
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 8152511521 8499802600 0.96
random-access/feature-vectors/correlated/vortex-tokio-local-disk 🚀 7784987 9328619 0.83
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 7011875 8038545 0.87
random-access/feature-vectors/uniform/lance-tokio-local-disk 1220742 1236962 0.99
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 1873623 1922887 0.97
random-access/feature-vectors/uniform/parquet-tokio-local-disk 8156014533 8676072120 0.94
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 8161892979 8685232880 0.94
random-access/feature-vectors/uniform/vortex-tokio-local-disk 13109884 14524761 0.90
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 12866450 14164942 0.91
random-access/lance-tokio-local-disk 642012 664589 0.97
random-access/lance-tokio-local-disk-footer 1284598 1369196 0.94
random-access/nested-lists/correlated/lance-tokio-local-disk 237029 246909 0.96
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 578134 598225 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk 125833613 133706863 0.94
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 128449624 133697821 0.96
random-access/nested-lists/correlated/vortex-tokio-local-disk 🚀 531105 731252 0.73
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 577311 719719 0.80
random-access/nested-lists/uniform/lance-tokio-local-disk 1026207 1037584 0.99
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1373726 1421917 0.97
random-access/nested-lists/uniform/parquet-tokio-local-disk 128015589 137193681 0.93
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 125317658 134889181 0.93
random-access/nested-lists/uniform/vortex-tokio-local-disk 2061674 2280997 0.90
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 2037144 2284778 0.89
random-access/nested-structs/correlated/lance-tokio-local-disk 366691 382502 0.96
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 544964 574131 0.95
random-access/nested-structs/correlated/parquet-tokio-local-disk 🚀 19986910 24120788 0.83
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 🚀 19968590 23852255 0.84
random-access/nested-structs/correlated/vortex-tokio-local-disk 🚀 635475 842592 0.75
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 🚀 706557 857676 0.82
random-access/nested-structs/uniform/lance-tokio-local-disk 2571291 2629096 0.98
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 2773462 2882567 0.96
random-access/nested-structs/uniform/parquet-tokio-local-disk 🚀 20028118 23828173 0.84
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 🚀 20106168 24000344 0.84
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀 1523500 1817713 0.84
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚀 1598224 1820260 0.88
random-access/parquet-tokio-local-disk 163789704 171857640 0.95
random-access/parquet-tokio-local-disk-footer 163529238 173475691 0.94
random-access/taxi/correlated/lance-tokio-local-disk 926473 979686 0.95
random-access/taxi/correlated/lance-tokio-local-disk-footer 1789636 1985470 0.90
random-access/taxi/correlated/parquet-tokio-local-disk 245281958 260543290 0.94
random-access/taxi/correlated/parquet-tokio-local-disk-footer 246245818 260580326 0.94
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1500988 2029553 0.74
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1663318 2021298 0.82
random-access/taxi/uniform/lance-tokio-local-disk 9474776 9955509 0.95
random-access/taxi/uniform/lance-tokio-local-disk-footer 10051149 10586330 0.95
random-access/taxi/uniform/parquet-tokio-local-disk 259876468 274697262 0.95
random-access/taxi/uniform/parquet-tokio-local-disk-footer 260985118 275702872 0.95
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4378396 5019379 0.87
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4341129 5015224 0.87
random-access/vortex-tokio-local-disk 🚀 1140341 1371083 0.83
random-access/vortex-tokio-local-disk-footer 🚀 1152226 1418161 0.81

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.4%
Vortex (geomean): 0.998x ➖
Parquet (geomean): 0.996x ➖
Shifts: Parquet (control) -0.4% · Median polish -0.3%

datafusion / vortex-file-compressed (0.996x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 405678283 401164010 1.01
tpch_q02/datafusion:vortex-file-compressed 106643516 108335796 0.98
tpch_q03/datafusion:vortex-file-compressed 215698656 215615117 1.00
tpch_q04/datafusion:vortex-file-compressed 111956886 110811056 1.01
tpch_q05/datafusion:vortex-file-compressed 369460877 368612514 1.00
tpch_q06/datafusion:vortex-file-compressed 35072487 35026663 1.00
tpch_q07/datafusion:vortex-file-compressed 494719193 501276984 0.99
tpch_q08/datafusion:vortex-file-compressed 355702448 355503403 1.00
tpch_q09/datafusion:vortex-file-compressed 622609175 629999760 0.99
tpch_q10/datafusion:vortex-file-compressed 228429176 228251230 1.00
tpch_q11/datafusion:vortex-file-compressed 82452248 81414197 1.01
tpch_q12/datafusion:vortex-file-compressed 114705724 114482554 1.00
tpch_q13/datafusion:vortex-file-compressed 212398940 215248189 0.99
tpch_q14/datafusion:vortex-file-compressed 51637173 50992592 1.01
tpch_q15/datafusion:vortex-file-compressed 97211841 98035147 0.99
tpch_q16/datafusion:vortex-file-compressed 74809012 76566155 0.98
tpch_q17/datafusion:vortex-file-compressed 628727444 636513515 0.99
tpch_q18/datafusion:vortex-file-compressed 834809035 847765468 0.98
tpch_q19/datafusion:vortex-file-compressed 67088423 67267702 1.00
tpch_q20/datafusion:vortex-file-compressed 158957386 161711790 0.98
tpch_q21/datafusion:vortex-file-compressed 654451944 659802358 0.99
tpch_q22/datafusion:vortex-file-compressed 65185963 65404546 1.00
datafusion / vortex-compact (1.001x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 432213366 431178926 1.00
tpch_q02/datafusion:vortex-compact 109372844 110366454 0.99
tpch_q03/datafusion:vortex-compact 214186731 217521450 0.98
tpch_q04/datafusion:vortex-compact 118278886 117943996 1.00
tpch_q05/datafusion:vortex-compact 371989412 374485992 0.99
tpch_q06/datafusion:vortex-compact 58956936 58258856 1.01
tpch_q07/datafusion:vortex-compact 510036199 517766828 0.99
tpch_q08/datafusion:vortex-compact 356788206 353056780 1.01
tpch_q09/datafusion:vortex-compact 629595581 634898728 0.99
tpch_q10/datafusion:vortex-compact 242970369 241504605 1.01
tpch_q11/datafusion:vortex-compact 82782621 83000858 1.00
tpch_q12/datafusion:vortex-compact 157900247 156538592 1.01
tpch_q13/datafusion:vortex-compact 264532632 262113862 1.01
tpch_q14/datafusion:vortex-compact 70282444 69454939 1.01
tpch_q15/datafusion:vortex-compact 153161091 151866839 1.01
tpch_q16/datafusion:vortex-compact 79979492 80045374 1.00
tpch_q17/datafusion:vortex-compact 627137538 631123274 0.99
tpch_q18/datafusion:vortex-compact 834514883 839821187 0.99
tpch_q19/datafusion:vortex-compact 122787035 120376394 1.02
tpch_q20/datafusion:vortex-compact 184210801 183567455 1.00
tpch_q21/datafusion:vortex-compact 654684155 661173603 0.99
tpch_q22/datafusion:vortex-compact 72590498 71788580 1.01
datafusion / parquet (0.995x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 445790066 453279487 0.98
tpch_q02/datafusion:parquet 170477415 172470601 0.99
tpch_q03/datafusion:parquet 279973949 280932573 1.00
tpch_q04/datafusion:parquet 123963375 124673858 0.99
tpch_q05/datafusion:parquet 431984912 436635812 0.99
tpch_q06/datafusion:parquet 126122242 125998876 1.00
tpch_q07/datafusion:parquet 600236679 606501387 0.99
tpch_q08/datafusion:parquet 456486995 462617053 0.99
tpch_q09/datafusion:parquet 736937817 746914604 0.99
tpch_q10/datafusion:parquet 502928440 498002911 1.01
tpch_q11/datafusion:parquet 115801542 117336618 0.99
tpch_q12/datafusion:parquet 191356124 193166878 0.99
tpch_q13/datafusion:parquet 332786093 331534222 1.00
tpch_q14/datafusion:parquet 161003068 157820266 1.02
tpch_q15/datafusion:parquet 241908891 246809921 0.98
tpch_q16/datafusion:parquet 127474004 124527750 1.02
tpch_q17/datafusion:parquet 672653739 683240702 0.98
tpch_q18/datafusion:parquet 870543209 887509840 0.98
tpch_q19/datafusion:parquet 258008385 252357641 1.02
tpch_q20/datafusion:parquet 288454155 288132914 1.00
tpch_q21/datafusion:parquet 684642661 693870428 0.99
tpch_q22/datafusion:parquet 211121180 213420303 0.99
datafusion / arrow (0.967x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 580259070 603872856 0.96
tpch_q02/datafusion:arrow 162650774 166252450 0.98
tpch_q03/datafusion:arrow 457494040 476479005 0.96
tpch_q04/datafusion:arrow 327598590 346330284 0.95
tpch_q05/datafusion:arrow 908918130 935460104 0.97
tpch_q06/datafusion:arrow 275874526 286431219 0.96
tpch_q07/datafusion:arrow 1153804640 1174347477 0.98
tpch_q08/datafusion:arrow 1132021491 1145266393 0.99
tpch_q09/datafusion:arrow 1317917114 1362084148 0.97
tpch_q10/datafusion:arrow 581325186 594339404 0.98
tpch_q11/datafusion:arrow 136828572 137272776 1.00
tpch_q12/datafusion:arrow 726107088 789191398 0.92
tpch_q13/datafusion:arrow 498741709 505653146 0.99
tpch_q14/datafusion:arrow 307556127 324989470 0.95
tpch_q15/datafusion:arrow 684928107 705001540 0.97
tpch_q16/datafusion:arrow 104289737 107037810 0.97
tpch_q17/datafusion:arrow 1318109336 1363523153 0.97
tpch_q18/datafusion:arrow 1864254052 1917851684 0.97
tpch_q19/datafusion:arrow 478124650 500924362 0.95
tpch_q20/datafusion:arrow 478309671 504302537 0.95
tpch_q21/datafusion:arrow 2961986351 3020933478 0.98
tpch_q22/datafusion:arrow 128064079 132538580 0.97
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 171638950 172940453 0.99
tpch_q02/duckdb:vortex-file-compressed 51060985 50727000 1.01
tpch_q03/duckdb:vortex-file-compressed 126278171 129117496 0.98
tpch_q04/duckdb:vortex-file-compressed 159102479 161082851 0.99
tpch_q05/duckdb:vortex-file-compressed 143875440 143706099 1.00
tpch_q06/duckdb:vortex-file-compressed 33634770 33525405 1.00
tpch_q07/duckdb:vortex-file-compressed 135740563 136834241 0.99
tpch_q08/duckdb:vortex-file-compressed 162578401 168400997 0.97
tpch_q09/duckdb:vortex-file-compressed 384531410 385157258 1.00
tpch_q10/duckdb:vortex-file-compressed 181669084 184001165 0.99
tpch_q11/duckdb:vortex-file-compressed 31641729 31746473 1.00
tpch_q12/duckdb:vortex-file-compressed 96733285 98248181 0.98
tpch_q13/duckdb:vortex-file-compressed 229041848 227898021 1.01
tpch_q14/duckdb:vortex-file-compressed 55782386 56899581 0.98
tpch_q15/duckdb:vortex-file-compressed 88728649 89238845 0.99
tpch_q16/duckdb:vortex-file-compressed 75509761 74253562 1.02
tpch_q17/duckdb:vortex-file-compressed 94019723 94381936 1.00
tpch_q18/duckdb:vortex-file-compressed 272083573 275723418 0.99
tpch_q19/duckdb:vortex-file-compressed 81781333 81257657 1.01
tpch_q20/duckdb:vortex-file-compressed 147981641 146494655 1.01
tpch_q21/duckdb:vortex-file-compressed 483533672 490574464 0.99
tpch_q22/duckdb:vortex-file-compressed 63013295 62873845 1.00
duckdb / vortex-compact (1.002x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 228348067 228876135 1.00
tpch_q02/duckdb:vortex-compact 55810721 55493941 1.01
tpch_q03/duckdb:vortex-compact 140532262 138708044 1.01
tpch_q04/duckdb:vortex-compact 171213466 174153403 0.98
tpch_q05/duckdb:vortex-compact 170412108 171709926 0.99
tpch_q06/duckdb:vortex-compact 54479666 53595375 1.02
tpch_q07/duckdb:vortex-compact 173567764 174628590 0.99
tpch_q08/duckdb:vortex-compact 181159210 184888541 0.98
tpch_q09/duckdb:vortex-compact 416142227 417896664 1.00
tpch_q10/duckdb:vortex-compact 211062145 209925525 1.01
tpch_q11/duckdb:vortex-compact 38143856 38462171 0.99
tpch_q12/duckdb:vortex-compact 162081618 161341485 1.00
tpch_q13/duckdb:vortex-compact 273439273 272740628 1.00
tpch_q14/duckdb:vortex-compact 74359955 72564677 1.02
tpch_q15/duckdb:vortex-compact 112852301 112894424 1.00
tpch_q16/duckdb:vortex-compact 76606926 77138721 0.99
tpch_q17/duckdb:vortex-compact 107831037 106006391 1.02
tpch_q18/duckdb:vortex-compact 282262584 282613951 1.00
tpch_q19/duckdb:vortex-compact 99274048 98742123 1.01
tpch_q20/duckdb:vortex-compact 182005727 177926580 1.02
tpch_q21/duckdb:vortex-compact 516198291 517340372 1.00
tpch_q22/duckdb:vortex-compact 69935594 69876379 1.00
duckdb / parquet (0.998x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 254436217 259629869 0.98
tpch_q02/duckdb:parquet 100719637 100438629 1.00
tpch_q03/duckdb:parquet 207205313 206984544 1.00
tpch_q04/duckdb:parquet 130856352 132824509 0.99
tpch_q05/duckdb:parquet 216525535 213512827 1.01
tpch_q06/duckdb:parquet 66549123 69033890 0.96
tpch_q07/duckdb:parquet 181954980 183390102 0.99
tpch_q08/duckdb:parquet 253592154 252053609 1.01
tpch_q09/duckdb:parquet 498259327 479482308 1.04
tpch_q10/duckdb:parquet 610573460 612009875 1.00
tpch_q11/duckdb:parquet 57600046 55967995 1.03
tpch_q12/duckdb:parquet 124556574 123523398 1.01
tpch_q13/duckdb:parquet 444175439 444221505 1.00
tpch_q14/duckdb:parquet 171267187 174577945 0.98
tpch_q15/duckdb:parquet 97420182 95223404 1.02
tpch_q16/duckdb:parquet 154499039 159661628 0.97
tpch_q17/duckdb:parquet 174018240 175137424 0.99
tpch_q18/duckdb:parquet 348409964 355482521 0.98
tpch_q19/duckdb:parquet 283784575 284230194 1.00
tpch_q20/duckdb:parquet 226324449 230906637 0.98
tpch_q21/duckdb:parquet 559077917 557077014 1.00
tpch_q22/duckdb:parquet 292633794 291530374 1.00
duckdb / duckdb (0.997x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 116654424 116232237 1.00
tpch_q02/duckdb:duckdb 49256546 47882786 1.03
tpch_q03/duckdb:duckdb 97173404 98056191 0.99
tpch_q04/duckdb:duckdb 131734340 134264736 0.98
tpch_q05/duckdb:duckdb 109457671 111299119 0.98
tpch_q06/duckdb:duckdb 37271734 37308301 1.00
tpch_q07/duckdb:duckdb 86201364 86855912 0.99
tpch_q08/duckdb:duckdb 110490835 111450708 0.99
tpch_q09/duckdb:duckdb 277945559 279104827 1.00
tpch_q10/duckdb:duckdb 203127947 204416974 0.99
tpch_q11/duckdb:duckdb 15644400 15971078 0.98
tpch_q12/duckdb:duckdb 85467570 84935508 1.01
tpch_q13/duckdb:duckdb 218445698 221114318 0.99
tpch_q14/duckdb:duckdb 70594958 71128392 0.99
tpch_q15/duckdb:duckdb 78504497 77348629 1.01
tpch_q16/duckdb:duckdb 73883344 73619811 1.00
tpch_q17/duckdb:duckdb 84576336 84711740 1.00
tpch_q18/duckdb:duckdb 210938975 214868136 0.98
tpch_q19/duckdb:duckdb 115850411 115663766 1.00
tpch_q20/duckdb:duckdb 112268656 112073115 1.00
tpch_q21/duckdb:duckdb 294980444 300214741 0.98
tpch_q22/duckdb:duckdb 65961773 63885929 1.03
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -3.9% -1.8% -2.1% +10.0% ➖ noise
1 datafusion:vortex-compact +0.2% -1.8% +2.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +1.1% -1.8% +3.0% +10.0% ➖ noise
1 duckdb:duckdb +0.4% -1.8% +2.2% +10.0% ➖ noise
1 duckdb:vortex-compact -0.2% -1.8% +1.6% +10.0% ➖ noise
1 duckdb:vortex-file-compressed -0.8% -1.8% +1.1% +10.0% ➖ noise
2 datafusion:arrow -2.2% -0.4% -1.7% +10.0% ➖ noise
2 datafusion:vortex-compact -0.9% -0.4% -0.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.6% -0.4% -1.1% +10.0% ➖ noise
2 duckdb:duckdb +2.9% -0.4% +3.3% +10.0% ➖ noise
2 duckdb:vortex-compact +0.6% -0.4% +1.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +0.7% -0.4% +1.1% +10.0% ➖ noise
3 datafusion:arrow -4.0% -0.1% -3.9% +10.0% ➖ noise
3 datafusion:vortex-compact -1.5% -0.1% -1.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +0.0% -0.1% +0.2% +10.0% ➖ noise
3 duckdb:duckdb -0.9% -0.1% -0.8% +10.0% ➖ noise
3 duckdb:vortex-compact +1.3% -0.1% +1.4% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -2.2% -0.1% -2.1% +10.0% ➖ noise
4 datafusion:arrow -5.4% -1.0% -4.4% +10.0% ➖ noise
4 datafusion:vortex-compact +0.3% -1.0% +1.3% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +1.0% -1.0% +2.1% +10.0% ➖ noise
4 duckdb:duckdb -1.9% -1.0% -0.9% +10.0% ➖ noise
4 duckdb:vortex-compact -1.7% -1.0% -0.7% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -1.2% -1.0% -0.2% +10.0% ➖ noise
5 datafusion:arrow -2.8% +0.2% -3.0% +10.0% ➖ noise
5 datafusion:vortex-compact -0.7% +0.2% -0.8% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +0.2% +0.2% +0.1% +10.0% ➖ noise
5 duckdb:duckdb -1.7% +0.2% -1.8% +10.0% ➖ noise
5 duckdb:vortex-compact -0.8% +0.2% -0.9% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +0.1% +0.2% -0.0% +10.0% ➖ noise
6 datafusion:arrow -3.7% -1.8% -2.0% +10.0% ➖ noise
6 datafusion:vortex-compact +1.2% -1.8% +3.0% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +0.1% -1.8% +1.9% +10.0% ➖ noise
6 duckdb:duckdb -0.1% -1.8% +1.7% +11.2% ➖ noise
6 duckdb:vortex-compact +1.6% -1.8% +3.5% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +0.3% -1.8% +2.1% +12.2% ➖ noise
7 datafusion:arrow -1.7% -0.9% -0.8% +10.0% ➖ noise
7 datafusion:vortex-compact -1.5% -0.9% -0.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -1.3% -0.9% -0.4% +10.0% ➖ noise
7 duckdb:duckdb -0.8% -0.9% +0.2% +10.0% ➖ noise
7 duckdb:vortex-compact -0.6% -0.9% +0.3% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -0.8% -0.9% +0.1% +10.0% ➖ noise
8 datafusion:arrow -1.2% -0.4% -0.8% +10.0% ➖ noise
8 datafusion:vortex-compact +1.1% -0.4% +1.4% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +0.1% -0.4% +0.4% +10.0% ➖ noise
8 duckdb:duckdb -0.9% -0.4% -0.5% +10.0% ➖ noise
8 duckdb:vortex-compact -2.0% -0.4% -1.7% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -3.5% -0.4% -3.1% +10.0% ➖ noise
9 datafusion:arrow -3.2% +1.3% -4.4% +10.0% ➖ noise
9 datafusion:vortex-compact -0.8% +1.3% -2.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -1.2% +1.3% -2.4% +10.0% ➖ noise
9 duckdb:duckdb -0.4% +1.3% -1.7% +10.0% ➖ noise
9 duckdb:vortex-compact -0.4% +1.3% -1.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -0.2% +1.3% -1.4% +10.0% ➖ noise
10 datafusion:arrow -2.2% +0.4% -2.6% +10.0% ➖ noise
10 datafusion:vortex-compact +0.6% +0.4% +0.2% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +0.1% +0.4% -0.3% +10.0% ➖ noise
10 duckdb:duckdb -0.6% +0.4% -1.0% +10.0% ➖ noise
10 duckdb:vortex-compact +0.5% +0.4% +0.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.3% +0.4% -1.6% +10.0% ➖ noise
11 datafusion:arrow -0.3% +0.8% -1.1% +10.5% ➖ noise
11 datafusion:vortex-compact -0.3% +0.8% -1.0% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +1.3% +0.8% +0.5% +10.0% ➖ noise
11 duckdb:duckdb -2.0% +0.8% -2.8% +13.4% ➖ noise
11 duckdb:vortex-compact -0.8% +0.8% -1.6% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -0.3% +0.8% -1.1% +10.0% ➖ noise
12 datafusion:arrow -8.0% -0.1% -7.9% +30.9% ➖ noise
12 datafusion:vortex-compact +0.9% -0.1% +0.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +0.2% -0.1% +0.2% +10.0% ➖ noise
12 duckdb:duckdb +0.6% -0.1% +0.7% +10.0% ➖ noise
12 duckdb:vortex-compact +0.5% -0.1% +0.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -1.5% -0.1% -1.5% +10.0% ➖ noise
13 datafusion:arrow -1.4% +0.2% -1.5% +10.0% ➖ noise
13 datafusion:vortex-compact +0.9% +0.2% +0.7% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -1.3% +0.2% -1.5% +10.0% ➖ noise
13 duckdb:duckdb -1.2% +0.2% -1.4% +10.0% ➖ noise
13 duckdb:vortex-compact +0.3% +0.2% +0.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +0.5% +0.2% +0.3% +10.0% ➖ noise
14 datafusion:arrow -5.4% +0.0% -5.4% +10.0% ➖ noise
14 datafusion:vortex-compact +1.2% +0.0% +1.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +1.3% +0.0% +1.2% +10.0% ➖ noise
14 duckdb:duckdb -0.7% +0.0% -0.8% +10.0% ➖ noise
14 duckdb:vortex-compact +2.5% +0.0% +2.4% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -2.0% +0.0% -2.0% +10.0% ➖ noise
15 datafusion:arrow -2.8% +0.1% -3.0% +10.0% ➖ noise
15 datafusion:vortex-compact +0.9% +0.1% +0.7% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -0.8% +0.1% -1.0% +10.0% ➖ noise
15 duckdb:duckdb +1.5% +0.1% +1.4% +10.0% ➖ noise
15 duckdb:vortex-compact -0.0% +0.1% -0.2% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -0.6% +0.1% -0.7% +10.0% ➖ noise
16 datafusion:arrow -2.6% -0.5% -2.1% +10.0% ➖ noise
16 datafusion:vortex-compact -0.1% -0.5% +0.4% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -2.3% -0.5% -1.8% +10.0% ➖ noise
16 duckdb:duckdb +0.4% -0.5% +0.8% +10.0% ➖ noise
16 duckdb:vortex-compact -0.7% -0.5% -0.2% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.7% -0.5% +2.2% +10.0% ➖ noise
17 datafusion:arrow -3.3% -1.1% -2.3% +10.0% ➖ noise
17 datafusion:vortex-compact -0.6% -1.1% +0.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -1.2% -1.1% -0.1% +10.0% ➖ noise
17 duckdb:duckdb -0.2% -1.1% +0.9% +10.0% ➖ noise
17 duckdb:vortex-compact +1.7% -1.1% +2.8% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -0.4% -1.1% +0.7% +10.0% ➖ noise
18 datafusion:arrow -2.8% -2.0% -0.9% +10.0% ➖ noise
18 datafusion:vortex-compact -0.6% -2.0% +1.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -1.5% -2.0% +0.4% +10.0% ➖ noise
18 duckdb:duckdb -1.8% -2.0% +0.1% +10.0% ➖ noise
18 duckdb:vortex-compact -0.1% -2.0% +1.9% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -1.3% -2.0% +0.6% +10.0% ➖ noise
19 datafusion:arrow -4.6% +1.0% -5.5% +10.0% ➖ noise
19 datafusion:vortex-compact +2.0% +1.0% +1.0% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -0.3% +1.0% -1.3% +10.0% ➖ noise
19 duckdb:duckdb +0.2% +1.0% -0.9% +10.0% ➖ noise
19 duckdb:vortex-compact +0.5% +1.0% -0.5% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +0.6% +1.0% -0.4% +10.0% ➖ noise
20 datafusion:arrow -5.2% -0.9% -4.3% +10.0% ➖ noise
20 datafusion:vortex-compact +0.4% -0.9% +1.3% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -1.7% -0.9% -0.8% +10.0% ➖ noise
20 duckdb:duckdb +0.2% -0.9% +1.1% +10.0% ➖ noise
20 duckdb:vortex-compact +2.3% -0.9% +3.3% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +1.0% -0.9% +2.0% +10.0% ➖ noise
21 datafusion:arrow -2.0% -0.5% -1.5% +10.0% ➖ noise
21 datafusion:vortex-compact -1.0% -0.5% -0.5% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -0.8% -0.5% -0.3% +10.0% ➖ noise
21 duckdb:duckdb -1.7% -0.5% -1.3% +10.0% ➖ noise
21 duckdb:vortex-compact -0.2% -0.5% +0.3% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -1.4% -0.5% -1.0% +10.0% ➖ noise
22 datafusion:arrow -3.4% -0.4% -3.0% +10.0% ➖ noise
22 datafusion:vortex-compact +1.1% -0.4% +1.5% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -0.3% -0.4% +0.0% +10.0% ➖ noise
22 duckdb:duckdb +3.2% -0.4% +3.6% +10.0% ➖ noise
22 duckdb:vortex-compact +0.1% -0.4% +0.4% +10.0% ➖ noise
22 duckdb:vortex-file-compressed +0.2% -0.4% +0.6% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -1.7%
Vortex (geomean): 0.936x ➖
Parquet (geomean): 0.954x ➖
Shifts: Parquet (control) -4.6% · Median polish -5.2%

datafusion / vortex-file-compressed (0.955x ➖, 4↑ 1↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 🚨 2128193 1924780 1.11
clickbench_q01/datafusion:vortex-file-compressed 19715080 20089052 0.98
clickbench_q02/datafusion:vortex-file-compressed 37562707 38719488 0.97
clickbench_q03/datafusion:vortex-file-compressed 42429718 44748062 0.95
clickbench_q04/datafusion:vortex-file-compressed 283097964 307350262 0.92
clickbench_q05/datafusion:vortex-file-compressed 302632225 332366856 0.91
clickbench_q06/datafusion:vortex-file-compressed 1656474 1750614 0.95
clickbench_q07/datafusion:vortex-file-compressed 22535220 24336834 0.93
clickbench_q08/datafusion:vortex-file-compressed 🚀 350478333 401226045 0.87
clickbench_q09/datafusion:vortex-file-compressed 541836054 596049854 0.91
clickbench_q10/datafusion:vortex-file-compressed 73487002 74186096 0.99
clickbench_q11/datafusion:vortex-file-compressed 85480070 86157391 0.99
clickbench_q12/datafusion:vortex-file-compressed 266750143 273277259 0.98
clickbench_q13/datafusion:vortex-file-compressed 402544366 423370361 0.95
clickbench_q14/datafusion:vortex-file-compressed 247954068 263794235 0.94
clickbench_q15/datafusion:vortex-file-compressed 320441627 328586436 0.98
clickbench_q16/datafusion:vortex-file-compressed 629184861 654210480 0.96
clickbench_q17/datafusion:vortex-file-compressed 626940523 666218589 0.94
clickbench_q18/datafusion:vortex-file-compressed 🚀 1288010781 1450040234 0.89
clickbench_q19/datafusion:vortex-file-compressed 34465966 36507986 0.94
clickbench_q20/datafusion:vortex-file-compressed 342165239 341260288 1.00
clickbench_q21/datafusion:vortex-file-compressed 361540365 370710401 0.98
clickbench_q22/datafusion:vortex-file-compressed 432503597 450621650 0.96
clickbench_q23/datafusion:vortex-file-compressed 634846294 626817467 1.01
clickbench_q24/datafusion:vortex-file-compressed 45938135 44395289 1.03
clickbench_q25/datafusion:vortex-file-compressed 71986404 72535968 0.99
clickbench_q26/datafusion:vortex-file-compressed 46246154 43523840 1.06
clickbench_q27/datafusion:vortex-file-compressed 716183179 710857889 1.01
clickbench_q28/datafusion:vortex-file-compressed 6591434347 6592170400 1.00
clickbench_q29/datafusion:vortex-file-compressed 237709606 237557841 1.00
clickbench_q30/datafusion:vortex-file-compressed 215082622 222700893 0.97
clickbench_q31/datafusion:vortex-file-compressed 250337989 265216542 0.94
clickbench_q32/datafusion:vortex-file-compressed 1082801613 1181327694 0.92
clickbench_q33/datafusion:vortex-file-compressed 1274904285 1344161507 0.95
clickbench_q34/datafusion:vortex-file-compressed 1273331486 1367940649 0.93
clickbench_q35/datafusion:vortex-file-compressed 450862094 474290237 0.95
clickbench_q36/datafusion:vortex-file-compressed 68795149 75814373 0.91
clickbench_q37/datafusion:vortex-file-compressed 33798900 36786650 0.92
clickbench_q38/datafusion:vortex-file-compressed 18448616 19703717 0.94
clickbench_q39/datafusion:vortex-file-compressed 127482408 139835580 0.91
clickbench_q40/datafusion:vortex-file-compressed 15291589 16794015 0.91
clickbench_q41/datafusion:vortex-file-compressed 🚀 14300849 15946446 0.90
clickbench_q42/datafusion:vortex-file-compressed 🚀 16524191 18654077 0.89
datafusion / parquet (0.940x ➖, 7↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1730909 1602475 1.08
clickbench_q01/datafusion:parquet 18701402 20027486 0.93
clickbench_q02/datafusion:parquet 45515490 48957575 0.93
clickbench_q03/datafusion:parquet 36631799 38781973 0.94
clickbench_q04/datafusion:parquet 292716789 321954292 0.91
clickbench_q05/datafusion:parquet 342444889 368560793 0.93
clickbench_q06/datafusion:parquet 1688912 1663840 1.02
clickbench_q07/datafusion:parquet 22562008 22779626 0.99
clickbench_q08/datafusion:parquet 370140116 390449888 0.95
clickbench_q09/datafusion:parquet 610783859 658945650 0.93
clickbench_q10/datafusion:parquet 103397724 111174300 0.93
clickbench_q11/datafusion:parquet 126883197 134340796 0.94
clickbench_q12/datafusion:parquet 337050753 366091856 0.92
clickbench_q13/datafusion:parquet 🚀 485225888 545410896 0.89
clickbench_q14/datafusion:parquet 336589481 359828046 0.94
clickbench_q15/datafusion:parquet 335354324 349976861 0.96
clickbench_q16/datafusion:parquet 663169978 685164653 0.97
clickbench_q17/datafusion:parquet 644300353 673430686 0.96
clickbench_q18/datafusion:parquet 1309500669 1392789277 0.94
clickbench_q19/datafusion:parquet 29822712 30056576 0.99
clickbench_q20/datafusion:parquet 600144069 617947450 0.97
clickbench_q21/datafusion:parquet 642937456 669291960 0.96
clickbench_q22/datafusion:parquet 953020145 1003916174 0.95
clickbench_q23/datafusion:parquet 3559747493 3782038699 0.94
clickbench_q24/datafusion:parquet 81088786 89443709 0.91
clickbench_q25/datafusion:parquet 129414862 135211867 0.96
clickbench_q26/datafusion:parquet 🚀 75546937 85943995 0.88
clickbench_q27/datafusion:parquet 1040125964 1063725505 0.98
clickbench_q28/datafusion:parquet 6556970701 6693176288 0.98
clickbench_q29/datafusion:parquet 230431284 235744047 0.98
clickbench_q30/datafusion:parquet 324028078 336351250 0.96
clickbench_q31/datafusion:parquet 🚀 349956531 393292305 0.89
clickbench_q32/datafusion:parquet 1183687399 1224269003 0.97
clickbench_q33/datafusion:parquet 1438096757 1580142491 0.91
clickbench_q34/datafusion:parquet 1446322471 1585638260 0.91
clickbench_q35/datafusion:parquet 457550686 476960061 0.96
clickbench_q36/datafusion:parquet 🚀 137870206 157501445 0.88
clickbench_q37/datafusion:parquet 🚀 54860841 61382116 0.89
clickbench_q38/datafusion:parquet 82946819 88823268 0.93
clickbench_q39/datafusion:parquet 255715092 273714392 0.93
clickbench_q40/datafusion:parquet 🚀 29328004 33317805 0.88
clickbench_q41/datafusion:parquet 🚀 26584182 30761310 0.86
clickbench_q42/datafusion:parquet 28360307 30757489 0.92
duckdb / vortex-file-compressed (0.917x ➖, 11↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 5941759 6046280 0.98
clickbench_q01/duckdb:vortex-file-compressed 🚀 11059558 12347131 0.90
clickbench_q02/duckdb:vortex-file-compressed 25125523 26072969 0.96
clickbench_q03/duckdb:vortex-file-compressed 29432504 31475875 0.94
clickbench_q04/duckdb:vortex-file-compressed 181126851 190084070 0.95
clickbench_q05/duckdb:vortex-file-compressed 167796525 184303953 0.91
clickbench_q06/duckdb:vortex-file-compressed 19998571 21013254 0.95
clickbench_q07/duckdb:vortex-file-compressed 14321222 14634327 0.98
clickbench_q08/duckdb:vortex-file-compressed 251499567 266979305 0.94
clickbench_q09/duckdb:vortex-file-compressed 332808355 345223106 0.96
clickbench_q10/duckdb:vortex-file-compressed 63860057 68333984 0.93
clickbench_q11/duckdb:vortex-file-compressed 73676150 80586606 0.91
clickbench_q12/duckdb:vortex-file-compressed 192366068 208623657 0.92
clickbench_q13/duckdb:vortex-file-compressed 399752117 418597256 0.95
clickbench_q14/duckdb:vortex-file-compressed 224130793 245077519 0.91
clickbench_q15/duckdb:vortex-file-compressed 241019728 252324764 0.96
clickbench_q16/duckdb:vortex-file-compressed 595398578 587431564 1.01
clickbench_q17/duckdb:vortex-file-compressed 483030655 498788482 0.97
clickbench_q18/duckdb:vortex-file-compressed 981084969 1015119053 0.97
clickbench_q19/duckdb:vortex-file-compressed 20336590 22570776 0.90
clickbench_q20/duckdb:vortex-file-compressed 324692917 337149063 0.96
clickbench_q21/duckdb:vortex-file-compressed 349769145 381058074 0.92
clickbench_q22/duckdb:vortex-file-compressed 593848715 556143218 1.07
clickbench_q23/duckdb:vortex-file-compressed 🚀 170897718 193317541 0.88
clickbench_q24/duckdb:vortex-file-compressed 🚀 33088094 39496274 0.84
clickbench_q25/duckdb:vortex-file-compressed 73058507 73598214 0.99
clickbench_q26/duckdb:vortex-file-compressed 🚀 38768114 43568751 0.89
clickbench_q27/duckdb:vortex-file-compressed 458106591 494429602 0.93
clickbench_q28/duckdb:vortex-file-compressed 2959517223 3010924105 0.98
clickbench_q29/duckdb:vortex-file-compressed 27794846 28550629 0.97
clickbench_q30/duckdb:vortex-file-compressed 184468773 194063922 0.95
clickbench_q31/duckdb:vortex-file-compressed 272024415 295294243 0.92
clickbench_q32/duckdb:vortex-file-compressed 1143789811 1264529565 0.90
clickbench_q33/duckdb:vortex-file-compressed 1152998728 1178530081 0.98
clickbench_q34/duckdb:vortex-file-compressed 1187563348 1297426971 0.92
clickbench_q35/duckdb:vortex-file-compressed 378801481 398373574 0.95
clickbench_q36/duckdb:vortex-file-compressed 🚀 22651710 29406851 0.77
clickbench_q37/duckdb:vortex-file-compressed 🚀 17105517 21355565 0.80
clickbench_q38/duckdb:vortex-file-compressed 🚀 18379277 21628923 0.85
clickbench_q39/duckdb:vortex-file-compressed 🚀 36058140 42398954 0.85
clickbench_q40/duckdb:vortex-file-compressed 🚀 16844577 22281854 0.76
clickbench_q41/duckdb:vortex-file-compressed 🚀 16320257 21475691 0.76
clickbench_q42/duckdb:vortex-file-compressed 🚀 18046831 23122124 0.78
duckdb / parquet (0.967x ➖, 2↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 25642401 28480709 0.90
clickbench_q01/duckdb:parquet 27528885 28258279 0.97
clickbench_q02/duckdb:parquet 47939877 48375506 0.99
clickbench_q03/duckdb:parquet 37852676 38892417 0.97
clickbench_q04/duckdb:parquet 200824220 215268158 0.93
clickbench_q05/duckdb:parquet 265776547 276450298 0.96
clickbench_q06/duckdb:parquet 45235797 46032635 0.98
clickbench_q07/duckdb:parquet 29032910 29721866 0.98
clickbench_q08/duckdb:parquet 270322403 277058444 0.98
clickbench_q09/duckdb:parquet 393541134 401412323 0.98
clickbench_q10/duckdb:parquet 81569146 83367018 0.98
clickbench_q11/duckdb:parquet 97830598 102002081 0.96
clickbench_q12/duckdb:parquet 283851211 295729835 0.96
clickbench_q13/duckdb:parquet 481280932 498675793 0.97
clickbench_q14/duckdb:parquet 323877078 348084963 0.93
clickbench_q15/duckdb:parquet 252536692 267768638 0.94
clickbench_q16/duckdb:parquet 637163269 673340893 0.95
clickbench_q17/duckdb:parquet 534638160 562195832 0.95
clickbench_q18/duckdb:parquet 1073773382 1123181377 0.96
clickbench_q19/duckdb:parquet 25252014 26067208 0.97
clickbench_q20/duckdb:parquet 428798539 432009893 0.99
clickbench_q21/duckdb:parquet 545059154 550978858 0.99
clickbench_q22/duckdb:parquet 928549156 943129976 0.98
clickbench_q23/duckdb:parquet 298166144 317419915 0.94
clickbench_q24/duckdb:parquet 67835830 69351007 0.98
clickbench_q25/duckdb:parquet 157120197 158679306 0.99
clickbench_q26/duckdb:parquet 47607758 51736711 0.92
clickbench_q27/duckdb:parquet 644488524 661025558 0.97
clickbench_q28/duckdb:parquet 4803827403 4915127568 0.98
clickbench_q29/duckdb:parquet 40800453 41380629 0.99
clickbench_q30/duckdb:parquet 298712399 306220657 0.98
clickbench_q31/duckdb:parquet 360642347 380439961 0.95
clickbench_q32/duckdb:parquet 1273040705 1221666245 1.04
clickbench_q33/duckdb:parquet 1376901005 1418979991 0.97
clickbench_q34/duckdb:parquet 1375795174 1450245402 0.95
clickbench_q35/duckdb:parquet 364153515 375003874 0.97
clickbench_q36/duckdb:parquet 49929074 46963260 1.06
clickbench_q37/duckdb:parquet 🚀 31083721 35139761 0.88
clickbench_q38/duckdb:parquet 33982134 33442371 1.02
clickbench_q39/duckdb:parquet 🚀 82682484 94376640 0.88
clickbench_q40/duckdb:parquet 17236698 18992765 0.91
clickbench_q41/duckdb:parquet 18480171 18468187 1.00
clickbench_q42/duckdb:parquet 22090133 20248635 1.09
duckdb / duckdb (0.939x ➖, 5↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 17487844 18394300 0.95
clickbench_q01/duckdb:duckdb 32685731 33601936 0.97
clickbench_q02/duckdb:duckdb 45391061 47056843 0.96
clickbench_q03/duckdb:duckdb 46661832 48913992 0.95
clickbench_q04/duckdb:duckdb 189673030 201861162 0.94
clickbench_q05/duckdb:duckdb 264484603 285640622 0.93
clickbench_q06/duckdb:duckdb 🚀 28253484 37819947 0.75
clickbench_q07/duckdb:duckdb 34322440 37731485 0.91
clickbench_q08/duckdb:duckdb 251799079 268386158 0.94
clickbench_q09/duckdb:duckdb 364327253 386255772 0.94
clickbench_q10/duckdb:duckdb 97672535 101771559 0.96
clickbench_q11/duckdb:duckdb 107444295 110522943 0.97
clickbench_q12/duckdb:duckdb 236865208 253395117 0.93
clickbench_q13/duckdb:duckdb 472216415 493083430 0.96
clickbench_q14/duckdb:duckdb 271522075 297683798 0.91
clickbench_q15/duckdb:duckdb 219720152 234650249 0.94
clickbench_q16/duckdb:duckdb 612804682 656561528 0.93
clickbench_q17/duckdb:duckdb 🚀 522797902 583174129 0.90
clickbench_q18/duckdb:duckdb 1151988600 1276684163 0.90
clickbench_q19/duckdb:duckdb 35011825 36013139 0.97
clickbench_q20/duckdb:duckdb 🚀 835987802 932931492 0.90
clickbench_q21/duckdb:duckdb 🚀 899316560 1010238347 0.89
clickbench_q22/duckdb:duckdb 1070784669 1089652700 0.98
clickbench_q23/duckdb:duckdb 258425716 283866049 0.91
clickbench_q24/duckdb:duckdb 61053980 64834833 0.94
clickbench_q25/duckdb:duckdb 141382834 147527757 0.96
clickbench_q26/duckdb:duckdb 58528770 61102329 0.96
clickbench_q27/duckdb:duckdb 985055340 976419438 1.01
clickbench_q28/duckdb:duckdb 4641399387 4855916524 0.96
clickbench_q29/duckdb:duckdb 48088447 50464990 0.95
clickbench_q30/duckdb:duckdb 258744387 275606297 0.94
clickbench_q31/duckdb:duckdb 433222297 448720656 0.97
clickbench_q32/duckdb:duckdb 1520362108 1621894443 0.94
clickbench_q33/duckdb:duckdb 2069137117 2107487055 0.98
clickbench_q34/duckdb:duckdb 2261969620 2226968088 1.02
clickbench_q35/duckdb:duckdb 282728530 290303142 0.97
clickbench_q36/duckdb:duckdb 41261220 44421063 0.93
clickbench_q37/duckdb:duckdb 31640676 31739555 1.00
clickbench_q38/duckdb:duckdb 30880922 33457061 0.92
clickbench_q39/duckdb:duckdb 🚀 63046404 77281522 0.82
clickbench_q40/duckdb:duckdb 31788415 32698402 0.97
clickbench_q41/duckdb:duckdb 30546111 31215106 0.98
clickbench_q42/duckdb:duckdb 29940636 33005618 0.91
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +10.6% -1.4% +12.1% +711.1% ➖ noise
0 duckdb:duckdb -4.9% -1.4% -3.6% +286.0% ➖ noise
0 duckdb:vortex-file-compressed -1.7% -1.4% -0.3% +485.7% ➖ noise
1 datafusion:vortex-file-compressed -1.9% -4.6% +2.9% +23.2% ➖ noise
1 duckdb:duckdb -2.7% -4.6% +2.0% +55.9% ➖ noise
1 duckdb:vortex-file-compressed -10.4% -4.6% -6.1% +25.7% ➖ noise
2 datafusion:vortex-file-compressed -3.0% -4.0% +1.1% +13.9% ➖ noise
2 duckdb:duckdb -3.5% -4.0% +0.5% +17.9% ➖ noise
2 duckdb:vortex-file-compressed -3.6% -4.0% +0.4% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -5.2% -4.1% -1.1% +139.9% ➖ noise
3 duckdb:duckdb -4.6% -4.1% -0.5% +35.7% ➖ noise
3 duckdb:vortex-file-compressed -6.5% -4.1% -2.5% +56.9% ➖ noise
4 datafusion:vortex-file-compressed -7.9% -7.9% +0.0% +10.0% ➖ noise
4 duckdb:duckdb -6.0% -7.9% +2.0% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.7% -7.9% +3.5% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -8.9% -5.5% -3.7% +10.0% ➖ noise
5 duckdb:duckdb -7.4% -5.5% -2.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -9.0% -5.5% -3.7% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -5.4% -0.1% -5.3% +48.4% ➖ noise
6 duckdb:duckdb -25.3% -0.1% -25.2% +27.0% ✅ faster
6 duckdb:vortex-file-compressed -4.8% -0.1% -4.7% +15.4% ➖ noise
7 datafusion:vortex-file-compressed -7.4% -1.6% -5.9% +14.0% ➖ noise
7 duckdb:duckdb -9.0% -1.6% -7.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -2.1% -1.6% -0.5% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -12.6% -3.8% -9.2% +10.0% ✅ faster
8 duckdb:duckdb -6.2% -3.8% -2.4% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -5.8% -3.8% -2.1% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -9.1% -4.7% -4.6% +10.0% ➖ noise
9 duckdb:duckdb -5.7% -4.7% -1.1% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.6% -4.7% +1.1% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -0.9% -4.6% +3.8% +10.0% ➖ noise
10 duckdb:duckdb -4.0% -4.6% +0.6% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -6.5% -4.6% -2.0% +10.0% ➖ noise
11 datafusion:vortex-file-compressed -0.8% -4.8% +4.2% +10.0% ➖ noise
11 duckdb:duckdb -2.8% -4.8% +2.1% +10.0% ➖ noise
11 duckdb:vortex-file-compressed -8.6% -4.8% -3.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -2.4% -6.0% +3.8% +10.0% ➖ noise
12 duckdb:duckdb -6.5% -6.0% -0.6% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -7.8% -6.0% -1.9% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -4.9% -7.3% +2.6% +10.0% ➖ noise
13 duckdb:duckdb -4.2% -7.3% +3.4% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -4.5% -7.3% +3.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -6.0% -6.7% +0.8% +10.0% ➖ noise
14 duckdb:duckdb -8.8% -6.7% -2.2% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -8.5% -6.7% -2.0% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -2.5% -4.9% +2.6% +10.0% ➖ noise
15 duckdb:duckdb -6.4% -4.9% -1.5% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -4.5% -4.9% +0.5% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -3.8% -4.3% +0.5% +10.0% ➖ noise
16 duckdb:duckdb -6.7% -4.3% -2.5% +10.0% ➖ noise
16 duckdb:vortex-file-compressed +1.4% -4.3% +5.9% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -5.9% -4.6% -1.3% +10.0% ➖ noise
17 duckdb:duckdb -10.4% -4.6% -6.0% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -3.2% -4.6% +1.5% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -11.2% -5.2% -6.3% +10.0% ➖ noise
18 duckdb:duckdb -9.8% -5.2% -4.8% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -3.4% -5.2% +1.9% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -5.6% -2.0% -3.7% +26.8% ➖ noise
19 duckdb:duckdb -2.8% -2.0% -0.8% +15.4% ➖ noise
19 duckdb:vortex-file-compressed -9.9% -2.0% -8.1% +18.3% ➖ noise
20 datafusion:vortex-file-compressed +0.3% -1.8% +2.1% +208.1% ➖ noise
20 duckdb:duckdb -10.4% -1.8% -8.7% +32.0% ➖ noise
20 duckdb:vortex-file-compressed -3.7% -1.8% -1.9% +58.1% ➖ noise
21 datafusion:vortex-file-compressed -2.5% -2.5% +0.0% +10.0% ➖ noise
21 duckdb:duckdb -11.0% -2.5% -8.7% +10.2% ➖ noise
21 duckdb:vortex-file-compressed -8.2% -2.5% -5.8% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -4.0% -3.3% -0.7% +16.0% ➖ noise
22 duckdb:duckdb -1.7% -3.3% +1.6% +11.6% ➖ noise
22 duckdb:vortex-file-compressed +6.8% -3.3% +10.5% +13.6% ➖ noise
23 datafusion:vortex-file-compressed +1.3% -6.0% +7.7% +51.7% ➖ noise
23 duckdb:duckdb -9.0% -6.0% -3.2% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -11.6% -6.0% -6.0% +22.4% ➖ noise
24 datafusion:vortex-file-compressed +3.5% -5.8% +9.9% +10.0% ➖ noise
24 duckdb:duckdb -5.8% -5.8% -0.0% +11.0% ➖ noise
24 duckdb:vortex-file-compressed -16.2% -5.8% -11.0% +16.6% ➖ noise
25 datafusion:vortex-file-compressed -0.8% -2.6% +1.9% +11.6% ➖ noise
25 duckdb:duckdb -4.2% -2.6% -1.6% +10.0% ➖ noise
25 duckdb:vortex-file-compressed -0.7% -2.6% +2.0% +12.9% ➖ noise
26 datafusion:vortex-file-compressed +6.3% -10.1% +18.1% +11.6% 🚨 regression
26 duckdb:duckdb -4.2% -10.1% +6.5% +14.0% ➖ noise
26 duckdb:vortex-file-compressed -11.0% -10.1% -1.1% +21.7% ➖ noise
27 datafusion:vortex-file-compressed +0.7% -2.4% +3.2% +10.0% ➖ noise
27 duckdb:duckdb +0.9% -2.4% +3.3% +10.0% ➖ noise
27 duckdb:vortex-file-compressed -7.3% -2.4% -5.1% +10.0% ➖ noise
28 datafusion:vortex-file-compressed -0.0% -2.1% +2.2% +10.0% ➖ noise
28 duckdb:duckdb -4.4% -2.1% -2.3% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -1.7% -2.1% +0.5% +10.0% ➖ noise
29 datafusion:vortex-file-compressed +0.1% -1.8% +1.9% +11.3% ➖ noise
29 duckdb:duckdb -4.7% -1.8% -2.9% +10.9% ➖ noise
29 duckdb:vortex-file-compressed -2.6% -1.8% -0.8% +14.4% ➖ noise
30 datafusion:vortex-file-compressed -3.4% -3.1% -0.4% +10.0% ➖ noise
30 duckdb:duckdb -6.1% -3.1% -3.2% +10.0% ➖ noise
30 duckdb:vortex-file-compressed -4.9% -3.1% -1.9% +10.0% ➖ noise
31 datafusion:vortex-file-compressed -5.6% -8.2% +2.8% +10.0% ➖ noise
31 duckdb:duckdb -3.5% -8.2% +5.1% +10.0% ➖ noise
31 duckdb:vortex-file-compressed -7.9% -8.2% +0.3% +10.0% ➖ noise
32 datafusion:vortex-file-compressed -8.3% +0.4% -8.7% +10.0% ➖ noise
32 duckdb:duckdb -6.3% +0.4% -6.6% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -9.5% +0.4% -9.9% +10.0% ✅ faster
33 datafusion:vortex-file-compressed -5.2% -6.0% +0.9% +10.0% ➖ noise
33 duckdb:duckdb -1.8% -6.0% +4.5% +10.0% ➖ noise
33 duckdb:vortex-file-compressed -2.2% -6.0% +4.1% +10.0% ➖ noise
34 datafusion:vortex-file-compressed -6.9% -7.0% +0.1% +10.0% ➖ noise
34 duckdb:duckdb +1.6% -7.0% +9.2% +10.0% ➖ noise
34 duckdb:vortex-file-compressed -8.5% -7.0% -1.6% +10.0% ➖ noise
35 datafusion:vortex-file-compressed -4.9% -3.5% -1.5% +10.0% ➖ noise
35 duckdb:duckdb -2.6% -3.5% +0.9% +10.0% ➖ noise
35 duckdb:vortex-file-compressed -4.9% -3.5% -1.5% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -9.3% -3.5% -5.9% +10.0% ➖ noise
36 duckdb:duckdb -7.1% -3.5% -3.7% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -23.0% -3.5% -20.2% +13.5% ✅ faster
37 datafusion:vortex-file-compressed -8.1% -11.1% +3.3% +10.5% ➖ noise
37 duckdb:duckdb -0.3% -11.1% +12.1% +11.5% 🚨 regression
37 duckdb:vortex-file-compressed -19.9% -11.1% -9.9% +12.3% ➖ noise
38 datafusion:vortex-file-compressed -6.4% -2.6% -3.9% +10.0% ➖ noise
38 duckdb:duckdb -7.7% -2.6% -5.2% +10.2% ➖ noise
38 duckdb:vortex-file-compressed -15.0% -2.6% -12.8% +10.0% ✅ faster
39 datafusion:vortex-file-compressed -8.8% -9.5% +0.8% +10.0% ➖ noise
39 duckdb:duckdb -18.4% -9.5% -9.8% +15.6% ➖ noise
39 duckdb:vortex-file-compressed -15.0% -9.5% -6.0% +10.1% ➖ noise
40 datafusion:vortex-file-compressed -8.9% -10.6% +1.9% +10.0% ➖ noise
40 duckdb:duckdb -2.8% -10.6% +8.8% +10.0% ➖ noise
40 duckdb:vortex-file-compressed -24.4% -10.6% -15.4% +11.4% ✅ faster
41 datafusion:vortex-file-compressed -10.3% -7.0% -3.6% +10.0% ➖ noise
41 duckdb:duckdb -2.1% -7.0% +5.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -24.0% -7.0% -18.3% +10.4% ✅ faster
42 datafusion:vortex-file-compressed -11.4% +0.3% -11.7% +10.2% ✅ faster
42 duckdb:duckdb -9.3% +0.3% -9.6% +19.2% ➖ noise
42 duckdb:vortex-file-compressed -21.9% +0.3% -22.2% +12.6% ✅ faster

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

File Sizes: Clickbench on NVME

File Size Changes (1 files changed, -0.0% overall, 0↑ 1↓)
File Scale Format Base HEAD Change %
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%

Totals:

  • vortex-compact: 7.06 GB → 7.06 GB (-0.0%)
  • vortex-file-compressed: 14.01 GB → 14.01 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +8.0%
Vortex (geomean): 1.090x ➖
Parquet (geomean): 1.009x ➖
Shifts: Parquet (control) +0.9% · Median polish +3.9%

datafusion / vortex-file-compressed (1.186x ➖, 0↑ 4↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 276865724 251957949 1.10
tpch_q02/datafusion:vortex-file-compressed 483544251 454879041 1.06
tpch_q03/datafusion:vortex-file-compressed 451201172 456681129 0.99
tpch_q04/datafusion:vortex-file-compressed 314256165 246581104 1.27
tpch_q05/datafusion:vortex-file-compressed 497472388 474695546 1.05
tpch_q06/datafusion:vortex-file-compressed 328603997 325311476 1.01
tpch_q07/datafusion:vortex-file-compressed 533409384 427272010 1.25
tpch_q08/datafusion:vortex-file-compressed 🚨 795146052 562531210 1.41
tpch_q09/datafusion:vortex-file-compressed 513704721 395581696 1.30
tpch_q10/datafusion:vortex-file-compressed 615930502 482656898 1.28
tpch_q11/datafusion:vortex-file-compressed 🚨 460521383 271173879 1.70
tpch_q12/datafusion:vortex-file-compressed 450920058 411764976 1.10
tpch_q13/datafusion:vortex-file-compressed 🚨 219667017 143974350 1.53
tpch_q14/datafusion:vortex-file-compressed 273607503 251547739 1.09
tpch_q15/datafusion:vortex-file-compressed 541956292 450365867 1.20
tpch_q16/datafusion:vortex-file-compressed 230055323 210648790 1.09
tpch_q17/datafusion:vortex-file-compressed 472007075 408803616 1.15
tpch_q18/datafusion:vortex-file-compressed 355276092 387548468 0.92
tpch_q19/datafusion:vortex-file-compressed 490436072 460299014 1.07
tpch_q20/datafusion:vortex-file-compressed 456191181 395177850 1.15
tpch_q21/datafusion:vortex-file-compressed 678053778 610062157 1.11
tpch_q22/datafusion:vortex-file-compressed 🚨 180836222 112289791 1.61
datafusion / vortex-compact (1.126x ➖, 0↑ 2↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 281777562 257922469 1.09
tpch_q02/datafusion:vortex-compact 512874457 419830186 1.22
tpch_q03/datafusion:vortex-compact 440356641 392306139 1.12
tpch_q04/datafusion:vortex-compact 232316129 229570598 1.01
tpch_q05/datafusion:vortex-compact 403444337 376833833 1.07
tpch_q06/datafusion:vortex-compact 350392602 321178428 1.09
tpch_q07/datafusion:vortex-compact 521150176 500269032 1.04
tpch_q08/datafusion:vortex-compact 560188478 586425111 0.96
tpch_q09/datafusion:vortex-compact 420318346 445262242 0.94
tpch_q10/datafusion:vortex-compact 523008469 503833310 1.04
tpch_q11/datafusion:vortex-compact 324122516 288805835 1.12
tpch_q12/datafusion:vortex-compact 416212429 448885822 0.93
tpch_q13/datafusion:vortex-compact 🚨 266458291 126791534 2.10
tpch_q14/datafusion:vortex-compact 294070716 230661636 1.27
tpch_q15/datafusion:vortex-compact 458707176 404996883 1.13
tpch_q16/datafusion:vortex-compact 203998694 206387897 0.99
tpch_q17/datafusion:vortex-compact 🚨 516619450 365342722 1.41
tpch_q18/datafusion:vortex-compact 367514747 354131999 1.04
tpch_q19/datafusion:vortex-compact 542876636 492660372 1.10
tpch_q20/datafusion:vortex-compact 538791312 474916191 1.13
tpch_q21/datafusion:vortex-compact 634190527 551373828 1.15
tpch_q22/datafusion:vortex-compact 143725913 119389174 1.20
datafusion / parquet (1.019x ➖, 0↑ 1↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 282553551 215884049 1.31
tpch_q02/datafusion:parquet 469330181 471906846 0.99
tpch_q03/datafusion:parquet 330582410 295271380 1.12
tpch_q04/datafusion:parquet 182610017 151938476 1.20
tpch_q05/datafusion:parquet 490668643 479476100 1.02
tpch_q06/datafusion:parquet 152867699 131397780 1.16
tpch_q07/datafusion:parquet 494406251 495361740 1.00
tpch_q08/datafusion:parquet 572617267 756419001 0.76
tpch_q09/datafusion:parquet 463069126 524451958 0.88
tpch_q10/datafusion:parquet 503829094 627351898 0.80
tpch_q11/datafusion:parquet 424627380 338707123 1.25
tpch_q12/datafusion:parquet 230807624 232679154 0.99
tpch_q13/datafusion:parquet 432178468 436565234 0.99
tpch_q14/datafusion:parquet 172065284 170265410 1.01
tpch_q15/datafusion:parquet 310487676 316269865 0.98
tpch_q16/datafusion:parquet 165724996 163246659 1.02
tpch_q17/datafusion:parquet 415386718 488997915 0.85
tpch_q18/datafusion:parquet 479510485 450380856 1.06
tpch_q19/datafusion:parquet 381420513 335920338 1.14
tpch_q20/datafusion:parquet 344798779 336568225 1.02
tpch_q21/datafusion:parquet 599838913 552042698 1.09
tpch_q22/datafusion:parquet 142663236 150929465 0.95
duckdb / vortex-file-compressed (1.046x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 318842649 283369465 1.13
tpch_q02/duckdb:vortex-file-compressed 1045585293 1048906037 1.00
tpch_q03/duckdb:vortex-file-compressed 707787531 711218460 1.00
tpch_q04/duckdb:vortex-file-compressed 412048616 429423601 0.96
tpch_q05/duckdb:vortex-file-compressed 830209771 909494492 0.91
tpch_q06/duckdb:vortex-file-compressed 313179514 329294506 0.95
tpch_q07/duckdb:vortex-file-compressed 981668352 908839607 1.08
tpch_q08/duckdb:vortex-file-compressed 1116773489 1043415944 1.07
tpch_q09/duckdb:vortex-file-compressed 1009521227 979270153 1.03
tpch_q10/duckdb:vortex-file-compressed 964098666 753138711 1.28
tpch_q11/duckdb:vortex-file-compressed 560540491 551785910 1.02
tpch_q12/duckdb:vortex-file-compressed 736909265 657660505 1.12
tpch_q13/duckdb:vortex-file-compressed 461430848 499853496 0.92
tpch_q14/duckdb:vortex-file-compressed 475322705 452765239 1.05
tpch_q15/duckdb:vortex-file-compressed 318560648 278989765 1.14
tpch_q16/duckdb:vortex-file-compressed 362037950 362773329 1.00
tpch_q17/duckdb:vortex-file-compressed 855081202 738181655 1.16
tpch_q18/duckdb:vortex-file-compressed 625129118 564684437 1.11
tpch_q19/duckdb:vortex-file-compressed 476105928 488034663 0.98
tpch_q20/duckdb:vortex-file-compressed 839041844 769665731 1.09
tpch_q21/duckdb:vortex-file-compressed 1139316723 1138216721 1.00
tpch_q22/duckdb:vortex-file-compressed 338431164 308884678 1.10
duckdb / vortex-compact (1.009x ➖, 0↑ 1↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 🚨 400053493 280821576 1.42
tpch_q02/duckdb:vortex-compact 994201880 988233191 1.01
tpch_q03/duckdb:vortex-compact 593120938 661424111 0.90
tpch_q04/duckdb:vortex-compact 347686943 406393077 0.86
tpch_q05/duckdb:vortex-compact 889339645 797559148 1.12
tpch_q06/duckdb:vortex-compact 331408302 354971395 0.93
tpch_q07/duckdb:vortex-compact 901655526 940188541 0.96
tpch_q08/duckdb:vortex-compact 964310035 1009315109 0.96
tpch_q09/duckdb:vortex-compact 995467352 983403574 1.01
tpch_q10/duckdb:vortex-compact 740517949 699192336 1.06
tpch_q11/duckdb:vortex-compact 472193500 491134780 0.96
tpch_q12/duckdb:vortex-compact 651663439 670071603 0.97
tpch_q13/duckdb:vortex-compact 497202661 462164938 1.08
tpch_q14/duckdb:vortex-compact 419955362 501990157 0.84
tpch_q15/duckdb:vortex-compact 316405643 349292508 0.91
tpch_q16/duckdb:vortex-compact 348590055 343988854 1.01
tpch_q17/duckdb:vortex-compact 643703470 677614326 0.95
tpch_q18/duckdb:vortex-compact 644593704 521306265 1.24
tpch_q19/duckdb:vortex-compact 522255475 484146238 1.08
tpch_q20/duckdb:vortex-compact 795501740 768640230 1.03
tpch_q21/duckdb:vortex-compact 1071343774 992098254 1.08
tpch_q22/duckdb:vortex-compact 278440729 278321057 1.00
duckdb / parquet (1.000x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 445707370 498521011 0.89
tpch_q02/duckdb:parquet 1221735690 1186587583 1.03
tpch_q03/duckdb:parquet 1053253843 1056003632 1.00
tpch_q04/duckdb:parquet 670788413 685279651 0.98
tpch_q05/duckdb:parquet 1291648977 1287100718 1.00
tpch_q06/duckdb:parquet 456633180 498873104 0.92
tpch_q07/duckdb:parquet 1310927415 1240642165 1.06
tpch_q08/duckdb:parquet 1653274415 1547019378 1.07
tpch_q09/duckdb:parquet 1447699841 1400233147 1.03
tpch_q10/duckdb:parquet 1457819238 1384068333 1.05
tpch_q11/duckdb:parquet 763988734 693435127 1.10
tpch_q12/duckdb:parquet 667688246 737345288 0.91
tpch_q13/duckdb:parquet 934057997 939669494 0.99
tpch_q14/duckdb:parquet 668427600 710282166 0.94
tpch_q15/duckdb:parquet 523676143 577735675 0.91
tpch_q16/duckdb:parquet 642464919 723091395 0.89
tpch_q17/duckdb:parquet 823154201 795401439 1.03
tpch_q18/duckdb:parquet 907000753 891689222 1.02
tpch_q19/duckdb:parquet 808875366 763487270 1.06
tpch_q20/duckdb:parquet 1173650736 1136074826 1.03
tpch_q21/duckdb:parquet 1193838034 1152584027 1.04
tpch_q22/duckdb:parquet 620620266 565941124 1.10
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +9.2% +8.2% +1.0% +91.4% ➖ noise
1 datafusion:vortex-file-compressed +9.9% +8.2% +1.6% +67.9% ➖ noise
1 duckdb:vortex-compact +42.5% +8.2% +31.7% +48.2% ➖ noise
1 duckdb:vortex-file-compressed +12.5% +8.2% +4.0% +52.0% ➖ noise
2 datafusion:vortex-compact +22.2% +1.2% +20.7% +34.1% ➖ noise
2 datafusion:vortex-file-compressed +6.3% +1.2% +5.0% +30.0% ➖ noise
2 duckdb:vortex-compact +0.6% +1.2% -0.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -0.3% +1.2% -1.5% +30.0% ➖ noise
3 datafusion:vortex-compact +12.2% +5.7% +6.2% +57.8% ➖ noise
3 datafusion:vortex-file-compressed -1.2% +5.7% -6.5% +62.7% ➖ noise
3 duckdb:vortex-compact -10.3% +5.7% -15.1% +30.0% ➖ noise
3 duckdb:vortex-file-compressed -0.5% +5.7% -5.8% +36.9% ➖ noise
4 datafusion:vortex-compact +1.2% +8.5% -6.7% +63.6% ➖ noise
4 datafusion:vortex-file-compressed +27.4% +8.5% +17.5% +51.0% ➖ noise
4 duckdb:vortex-compact -14.4% +8.5% -21.1% +55.5% ➖ noise
4 duckdb:vortex-file-compressed -4.0% +8.5% -11.5% +49.2% ➖ noise
5 datafusion:vortex-compact +7.1% +1.3% +5.6% +30.0% ➖ noise
5 datafusion:vortex-file-compressed +4.8% +1.3% +3.4% +30.0% ➖ noise
5 duckdb:vortex-compact +11.5% +1.3% +10.0% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -8.7% +1.3% -9.9% +30.0% ➖ noise
6 datafusion:vortex-compact +9.1% +3.2% +5.7% +30.0% ➖ noise
6 datafusion:vortex-file-compressed +1.0% +3.2% -2.1% +34.4% ➖ noise
6 duckdb:vortex-compact -6.6% +3.2% -9.5% +30.9% ➖ noise
6 duckdb:vortex-file-compressed -4.9% +3.2% -7.8% +30.0% ➖ noise
7 datafusion:vortex-compact +4.2% +2.7% +1.4% +30.0% ➖ noise
7 datafusion:vortex-file-compressed +24.8% +2.7% +21.6% +36.2% ➖ noise
7 duckdb:vortex-compact -4.1% +2.7% -6.6% +30.0% ➖ noise
7 duckdb:vortex-file-compressed +8.0% +2.7% +5.2% +30.0% ➖ noise
8 datafusion:vortex-compact -4.5% -10.1% +6.2% +35.8% ➖ noise
8 datafusion:vortex-file-compressed +41.4% -10.1% +57.2% +30.0% 🚨 regression
8 duckdb:vortex-compact -4.5% -10.1% +6.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed +7.0% -10.1% +19.0% +30.0% ➖ noise
9 datafusion:vortex-compact -5.6% -4.5% -1.2% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +29.9% -4.5% +35.9% +30.0% 🚨 regression
9 duckdb:vortex-compact +1.2% -4.5% +5.9% +30.0% ➖ noise
9 duckdb:vortex-file-compressed +3.1% -4.5% +7.9% +30.0% ➖ noise
10 datafusion:vortex-compact +3.8% -8.0% +12.9% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +27.6% -8.0% +38.8% +30.0% 🚨 regression
10 duckdb:vortex-compact +5.9% -8.0% +15.2% +30.0% ➖ noise
10 duckdb:vortex-file-compressed +28.0% -8.0% +39.2% +30.0% 🚨 regression
11 datafusion:vortex-compact +12.2% +17.5% -4.5% +30.0% ➖ noise
11 datafusion:vortex-file-compressed +69.8% +17.5% +44.5% +30.0% 🚨 regression
11 duckdb:vortex-compact -3.9% +17.5% -18.2% +30.0% ➖ noise
11 duckdb:vortex-file-compressed +1.6% +17.5% -13.6% +30.0% ➖ noise
12 datafusion:vortex-compact -7.3% -5.2% -2.2% +33.1% ➖ noise
12 datafusion:vortex-file-compressed +9.5% -5.2% +15.5% +30.0% ➖ noise
12 duckdb:vortex-compact -2.7% -5.2% +2.6% +30.0% ➖ noise
12 duckdb:vortex-file-compressed +12.1% -5.2% +18.2% +30.0% ➖ noise
13 datafusion:vortex-compact +110.2% -0.8% +111.9% +59.6% 🚨 regression
13 datafusion:vortex-file-compressed +52.6% -0.8% +53.8% +53.0% 🚨 regression
13 duckdb:vortex-compact +7.6% -0.8% +8.5% +30.0% ➖ noise
13 duckdb:vortex-file-compressed -7.7% -0.8% -6.9% +30.0% ➖ noise
14 datafusion:vortex-compact +27.5% -2.5% +30.7% +38.1% ➖ noise
14 datafusion:vortex-file-compressed +8.8% -2.5% +11.5% +31.4% ➖ noise
14 duckdb:vortex-compact -16.3% -2.5% -14.2% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +5.0% -2.5% +7.7% +30.0% ➖ noise
15 datafusion:vortex-compact +13.3% -5.7% +20.1% +30.0% ➖ noise
15 datafusion:vortex-file-compressed +20.3% -5.7% +27.6% +30.0% ➖ noise
15 duckdb:vortex-compact -9.4% -5.7% -4.0% +30.0% ➖ noise
15 duckdb:vortex-file-compressed +14.2% -5.7% +21.0% +30.0% ➖ noise
16 datafusion:vortex-compact -1.2% -5.0% +4.1% +30.0% ➖ noise
16 datafusion:vortex-file-compressed +9.2% -5.0% +15.0% +30.0% ➖ noise
16 duckdb:vortex-compact +1.3% -5.0% +6.7% +30.0% ➖ noise
16 duckdb:vortex-file-compressed -0.2% -5.0% +5.1% +30.0% ➖ noise
17 datafusion:vortex-compact +41.4% -6.2% +50.8% +30.0% 🚨 regression
17 datafusion:vortex-file-compressed +15.5% -6.2% +23.1% +30.0% ➖ noise
17 duckdb:vortex-compact -5.0% -6.2% +1.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed +15.8% -6.2% +23.5% +30.0% ➖ noise
18 datafusion:vortex-compact +3.8% +4.1% -0.3% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -8.3% +4.1% -11.9% +30.0% ➖ noise
18 duckdb:vortex-compact +23.6% +4.1% +18.8% +30.0% ➖ noise
18 duckdb:vortex-file-compressed +10.7% +4.1% +6.4% +30.0% ➖ noise
19 datafusion:vortex-compact +10.2% +9.7% +0.5% +52.0% ➖ noise
19 datafusion:vortex-file-compressed +6.5% +9.7% -2.9% +30.0% ➖ noise
19 duckdb:vortex-compact +7.9% +9.7% -1.6% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -2.4% +9.7% -11.1% +30.0% ➖ noise
20 datafusion:vortex-compact +13.4% +2.9% +10.3% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +15.4% +2.9% +12.2% +30.0% ➖ noise
20 duckdb:vortex-compact +3.5% +2.9% +0.6% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +9.0% +2.9% +6.0% +30.0% ➖ noise
21 datafusion:vortex-compact +15.0% +6.1% +8.4% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +11.1% +6.1% +4.8% +30.0% ➖ noise
21 duckdb:vortex-compact +8.0% +6.1% +1.8% +30.0% ➖ noise
21 duckdb:vortex-file-compressed +0.1% +6.1% -5.6% +30.0% ➖ noise
22 datafusion:vortex-compact +20.4% +1.8% +18.2% +30.0% ➖ noise
22 datafusion:vortex-file-compressed +61.0% +1.8% +58.2% +30.0% 🚨 regression
22 duckdb:vortex-compact +0.0% +1.8% -1.7% +30.0% ➖ noise
22 duckdb:vortex-file-compressed +9.6% +1.8% +7.6% +30.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Benchmarks: Compression

Vortex (geomean): 0.991x ➖
Parquet (geomean): 0.973x ➖

unknown / unknown (0.965x ➖, 12↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
compress time/Arade 1130546033 1222229498 0.92
compress time/Bimbo 6755628851 7449181810 0.91
compress time/CMSprovider 2830800506 3045527312 0.93
compress time/Euro2016 430688845 464141610 0.93
compress time/Food 🚀 371924190 414883156 0.90
compress time/HashTags 802686010 856723990 0.94
compress time/TPC-H l_comment canonical 1277128239 1361066721 0.94
compress time/TPC-H l_comment chunked 1284952244 1375447328 0.93
compress time/taxi 712207996 766044138 0.93
compress time/wide table cols=100 chunks=1 rows=1000 🚀 10971572 12631069 0.87
compress time/wide table cols=100 chunks=50 rows=1000 11406954 12438588 0.92
compress time/wide table cols=1000 chunks=1 rows=1000 129303953 132821168 0.97
compress time/wide table cols=1000 chunks=50 rows=1000 122939974 134102077 0.92
compress time/wide table cols=10000 chunks=1 rows=1000 1426008390 1494235900 0.95
compress time/wide table cols=10000 chunks=50 rows=1000 1426477904 1528506852 0.93
decompress time/Arade 🚀 26314265 29702568 0.89
decompress time/Bimbo 78065463 83769527 0.93
decompress time/CMSprovider 🚀 75891132 89954616 0.84
decompress time/Euro2016 18169412 19657715 0.92
decompress time/Food 7971008 7802570 1.02
decompress time/HashTags 71989294 77009493 0.93
decompress time/TPC-H l_comment canonical 39900674 43739984 0.91
decompress time/TPC-H l_comment chunked 40932359 42211072 0.97
decompress time/taxi 🚀 14399781 16034114 0.90
decompress time/wide table cols=100 chunks=1 rows=1000 2428018 2675475 0.91
decompress time/wide table cols=100 chunks=50 rows=1000 🚀 2495262 2796748 0.89
decompress time/wide table cols=1000 chunks=1 rows=1000 22465770 22446316 1.00
decompress time/wide table cols=1000 chunks=50 rows=1000 22720274 24157926 0.94
decompress time/wide table cols=10000 chunks=1 rows=1000 252521748 278790765 0.91
decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 247314573 295228486 0.84
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 2563720551 2696294399 0.95
parquet_rs-zstd compress time/Bimbo 12544127382 13157202903 0.95
parquet_rs-zstd compress time/CMSprovider 6703687806 7437656591 0.90
parquet_rs-zstd compress time/Euro2016 1279826526 1368511425 0.94
parquet_rs-zstd compress time/Food 781475127 819347458 0.95
parquet_rs-zstd compress time/HashTags 2113584268 2348294965 0.90
parquet_rs-zstd compress time/TPC-H l_comment canonical 3136423906 3314367948 0.95
parquet_rs-zstd compress time/TPC-H l_comment chunked 3184302966 3353370025 0.95
parquet_rs-zstd compress time/taxi 1184506075 1256805813 0.94
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6141525 6935816 0.89
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 🚀 6102807 6808934 0.90
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 74122859 78693543 0.94
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 73865658 80125590 0.92
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 777096614 811658710 0.96
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 765458661 821014510 0.93
parquet_rs-zstd decompress time/Arade 614758626 631950651 0.97
parquet_rs-zstd decompress time/Bimbo 1676689499 1713726339 0.98
parquet_rs-zstd decompress time/CMSprovider 1677268074 1801573164 0.93
parquet_rs-zstd decompress time/Euro2016 372227249 395495705 0.94
parquet_rs-zstd decompress time/Food 195995220 204442138 0.96
parquet_rs-zstd decompress time/HashTags 🚀 623683592 728915271 0.86
parquet_rs-zstd decompress time/TPC-H l_comment canonical 586095914 606855654 0.97
parquet_rs-zstd decompress time/TPC-H l_comment chunked 590907109 610366775 0.97
parquet_rs-zstd decompress time/taxi 242152724 250828108 0.97
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2813398 2872146 0.98
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2741907 3015758 0.91
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31846345 32966717 0.97
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 🚀 32124485 35967654 0.89
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 343212480 348951320 0.98
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 341571918 355487617 0.96
vortex-file-compressed size/Arade 145363796 145363796 1.00
vortex-file-compressed size/Bimbo 468763332 468763332 1.00
vortex-file-compressed size/CMSprovider 417907812 417907812 1.00
vortex-file-compressed size/Euro2016 163599156 163757340 1.00
vortex-file-compressed size/Food 41926936 41926936 1.00
vortex-file-compressed size/HashTags 195647828 195647828 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179087360 179087360 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179087360 179087360 1.00
vortex-file-compressed size/taxi 52363948 52363948 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 930848 930848 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 9293648 9293648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 92957648 92957648 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 92957648 92957648 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 0.97
vortex:parquet-zstd ratio compress time/Bimbo 0 0 0.95
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.03
vortex:parquet-zstd ratio compress time/Euro2016 0 0 0.99
vortex:parquet-zstd ratio compress time/Food 0 0 0.94
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.04
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 0.99
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio compress time/taxi 0 0 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.98
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 1.02
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.03
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.91
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.95
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 0.91
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 0.98
vortex:parquet-zstd ratio decompress time/Food 0 0 1.07
vortex:parquet-zstd ratio decompress time/HashTags 0 0 1.09
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.94
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 1.00
vortex:parquet-zstd ratio decompress time/taxi 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 0 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 1.05
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 0.92
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 🚀 0 0 0.87
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 18, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -3.1%
Vortex (geomean): 0.955x ➖
Parquet (geomean): 0.985x ➖
Shifts: Parquet (control) -1.5% · Median polish -5.0%

datafusion / vortex-file-compressed (0.966x ➖, 1↑ 1↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 771591384 738445550 1.04
tpch_q02/datafusion:vortex-file-compressed 929466242 1179717358 0.79
tpch_q03/datafusion:vortex-file-compressed 1000130140 990791505 1.01
tpch_q04/datafusion:vortex-file-compressed 695890673 635866332 1.09
tpch_q05/datafusion:vortex-file-compressed 924587569 993239186 0.93
tpch_q06/datafusion:vortex-file-compressed 559908943 587994292 0.95
tpch_q07/datafusion:vortex-file-compressed 954934385 1059925167 0.90
tpch_q08/datafusion:vortex-file-compressed 1307745887 1195594784 1.09
tpch_q09/datafusion:vortex-file-compressed 1471554095 1338948154 1.10
tpch_q10/datafusion:vortex-file-compressed 993398584 907997781 1.09
tpch_q11/datafusion:vortex-file-compressed 546704992 515879098 1.06
tpch_q12/datafusion:vortex-file-compressed 900655816 866652184 1.04
tpch_q13/datafusion:vortex-file-compressed 467729904 483263061 0.97
tpch_q14/datafusion:vortex-file-compressed 562195492 597584054 0.94
tpch_q15/datafusion:vortex-file-compressed 969713719 1083058161 0.90
tpch_q16/datafusion:vortex-file-compressed 390923941 482750145 0.81
tpch_q17/datafusion:vortex-file-compressed 1120485255 1442311337 0.78
tpch_q18/datafusion:vortex-file-compressed 1210752941 1325881385 0.91
tpch_q19/datafusion:vortex-file-compressed 849881506 878628958 0.97
tpch_q20/datafusion:vortex-file-compressed 🚨 1157112120 884408254 1.31
tpch_q21/datafusion:vortex-file-compressed 2270022818 1801474423 1.26
tpch_q22/datafusion:vortex-file-compressed 🚀 345195880 581818606 0.59
datafusion / vortex-compact (0.978x ➖, 0↑ 1↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 675866147 734554747 0.92
tpch_q02/datafusion:vortex-compact 700263939 886195553 0.79
tpch_q03/datafusion:vortex-compact 1106932172 959093008 1.15
tpch_q04/datafusion:vortex-compact 804847218 871503642 0.92
tpch_q05/datafusion:vortex-compact 1419785758 1275554807 1.11
tpch_q06/datafusion:vortex-compact 587352112 668142774 0.88
tpch_q07/datafusion:vortex-compact 1137959529 1114615546 1.02
tpch_q08/datafusion:vortex-compact 1119861812 1132168708 0.99
tpch_q09/datafusion:vortex-compact 1179951568 1183906822 1.00
tpch_q10/datafusion:vortex-compact 815035854 855173512 0.95
tpch_q11/datafusion:vortex-compact 🚨 518496649 396597593 1.31
tpch_q12/datafusion:vortex-compact 813859241 769687166 1.06
tpch_q13/datafusion:vortex-compact 451669028 440181119 1.03
tpch_q14/datafusion:vortex-compact 549443126 536955762 1.02
tpch_q15/datafusion:vortex-compact 883380892 1010780505 0.87
tpch_q16/datafusion:vortex-compact 331113672 338032593 0.98
tpch_q17/datafusion:vortex-compact 1199024255 1206809737 0.99
tpch_q18/datafusion:vortex-compact 1125944894 1202876858 0.94
tpch_q19/datafusion:vortex-compact 852289538 947680138 0.90
tpch_q20/datafusion:vortex-compact 888543752 960104516 0.93
tpch_q21/datafusion:vortex-compact 1505216587 1578472067 0.95
tpch_q22/datafusion:vortex-compact 528406638 578570869 0.91
datafusion / parquet (1.081x ➖, 0↑ 3↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 977734508 944316690 1.04
tpch_q02/datafusion:parquet 1101398805 1092735902 1.01
tpch_q03/datafusion:parquet 1045792286 917488509 1.14
tpch_q04/datafusion:parquet 🚨 596416555 457042667 1.30
tpch_q05/datafusion:parquet 1166314195 1253592402 0.93
tpch_q06/datafusion:parquet 586240426 588612707 1.00
tpch_q07/datafusion:parquet 1572864349 1345236933 1.17
tpch_q08/datafusion:parquet 1678659425 1516008830 1.11
tpch_q09/datafusion:parquet 2203233825 1838818480 1.20
tpch_q10/datafusion:parquet 🚨 2708735315 2000454758 1.35
tpch_q11/datafusion:parquet 645789591 574121196 1.12
tpch_q12/datafusion:parquet 624506813 694750201 0.90
tpch_q13/datafusion:parquet 684118095 733126164 0.93
tpch_q14/datafusion:parquet 852840843 868478104 0.98
tpch_q15/datafusion:parquet 1514175318 1399854355 1.08
tpch_q16/datafusion:parquet 🚨 532403634 378561167 1.41
tpch_q17/datafusion:parquet 1682473817 1380942267 1.22
tpch_q18/datafusion:parquet 1691635997 1548292367 1.09
tpch_q19/datafusion:parquet 926924140 974169754 0.95
tpch_q20/datafusion:parquet 1226145262 1235576664 0.99
tpch_q21/datafusion:parquet 2064351826 1826905439 1.13
tpch_q22/datafusion:parquet 832695358 911712810 0.91
duckdb / vortex-file-compressed (0.939x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 586315912 701955416 0.84
tpch_q02/duckdb:vortex-file-compressed 1306873735 1481386428 0.88
tpch_q03/duckdb:vortex-file-compressed 972014185 999097416 0.97
tpch_q04/duckdb:vortex-file-compressed 760000853 871001085 0.87
tpch_q05/duckdb:vortex-file-compressed 1232721261 1421550333 0.87
tpch_q06/duckdb:vortex-file-compressed 641084271 555082265 1.15
tpch_q07/duckdb:vortex-file-compressed 1335539368 1432748529 0.93
tpch_q08/duckdb:vortex-file-compressed 1540228929 1636627825 0.94
tpch_q09/duckdb:vortex-file-compressed 1699205831 1960761914 0.87
tpch_q10/duckdb:vortex-file-compressed 1294266241 1315378966 0.98
tpch_q11/duckdb:vortex-file-compressed 701268713 708927167 0.99
tpch_q12/duckdb:vortex-file-compressed 1244187256 1232053545 1.01
tpch_q13/duckdb:vortex-file-compressed 936011849 1102835728 0.85
tpch_q14/duckdb:vortex-file-compressed 679630476 678489781 1.00
tpch_q15/duckdb:vortex-file-compressed 528010412 676468840 0.78
tpch_q16/duckdb:vortex-file-compressed 497687565 461609219 1.08
tpch_q17/duckdb:vortex-file-compressed 977669206 1066048204 0.92
tpch_q18/duckdb:vortex-file-compressed 901891340 973949916 0.93
tpch_q19/duckdb:vortex-file-compressed 752974167 846817921 0.89
tpch_q20/duckdb:vortex-file-compressed 1285878707 1209839224 1.06
tpch_q21/duckdb:vortex-file-compressed 1943503117 1987987340 0.98
tpch_q22/duckdb:vortex-file-compressed 421979341 439468268 0.96
duckdb / vortex-compact (0.936x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 638366880 625617204 1.02
tpch_q02/duckdb:vortex-compact 1150859854 1178998189 0.98
tpch_q03/duckdb:vortex-compact 822460376 933581610 0.88
tpch_q04/duckdb:vortex-compact 588499687 682824304 0.86
tpch_q05/duckdb:vortex-compact 1055439735 1297054495 0.81
tpch_q06/duckdb:vortex-compact 564392854 554947709 1.02
tpch_q07/duckdb:vortex-compact 1137041111 1303036781 0.87
tpch_q08/duckdb:vortex-compact 1435196669 1513658996 0.95
tpch_q09/duckdb:vortex-compact 1615743389 1600808355 1.01
tpch_q10/duckdb:vortex-compact 1011804210 1181266676 0.86
tpch_q11/duckdb:vortex-compact 676455114 694616490 0.97
tpch_q12/duckdb:vortex-compact 1085420275 1192644858 0.91
tpch_q13/duckdb:vortex-compact 861011058 885779073 0.97
tpch_q14/duckdb:vortex-compact 637567850 766217361 0.83
tpch_q15/duckdb:vortex-compact 505828298 567919017 0.89
tpch_q16/duckdb:vortex-compact 413635328 439066321 0.94
tpch_q17/duckdb:vortex-compact 940704229 954027006 0.99
tpch_q18/duckdb:vortex-compact 783015074 851117080 0.92
tpch_q19/duckdb:vortex-compact 733162533 771049614 0.95
tpch_q20/duckdb:vortex-compact 1187581962 1165825367 1.02
tpch_q21/duckdb:vortex-compact 1686016052 1773204954 0.95
tpch_q22/duckdb:vortex-compact 456661319 436421389 1.05
duckdb / parquet (0.898x ➖, 0↑ 0↓)
name PR 20d8b2e (ns) base 7b47788 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 886959747 974060974 0.91
tpch_q02/duckdb:parquet 1403765575 1563793037 0.90
tpch_q03/duckdb:parquet 1934098939 1908748037 1.01
tpch_q04/duckdb:parquet 1020886436 1221846231 0.84
tpch_q05/duckdb:parquet 2046386832 2130288347 0.96
tpch_q06/duckdb:parquet 771243546 886048693 0.87
tpch_q07/duckdb:parquet 1904874739 1947172899 0.98
tpch_q08/duckdb:parquet 2412038401 2613483709 0.92
tpch_q09/duckdb:parquet 2621025086 2782751227 0.94
tpch_q10/duckdb:parquet 3253471154 3902585372 0.83
tpch_q11/duckdb:parquet 1033179579 1166653096 0.89
tpch_q12/duckdb:parquet 1265874257 1388258958 0.91
tpch_q13/duckdb:parquet 1245623006 1493160282 0.83
tpch_q14/duckdb:parquet 1435588830 1376572754 1.04
tpch_q15/duckdb:parquet 959902225 1086080010 0.88
tpch_q16/duckdb:parquet 871567521 979158550 0.89
tpch_q17/duckdb:parquet 1302594741 1493729358 0.87
tpch_q18/duckdb:parquet 1503798889 1832775342 0.82
tpch_q19/duckdb:parquet 1517282785 1696722393 0.89
tpch_q20/duckdb:parquet 2061187574 2349723068 0.88
tpch_q21/duckdb:parquet 1721716948 2084874876 0.83
tpch_q22/duckdb:parquet 1048881671 1182815371 0.89
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -8.0% -2.9% -5.2% +45.9% ➖ noise
1 datafusion:vortex-file-compressed +4.5% -2.9% +7.6% +64.8% ➖ noise
1 duckdb:vortex-compact +2.0% -2.9% +5.1% +30.1% ➖ noise
1 duckdb:vortex-file-compressed -16.5% -2.9% -14.0% +33.0% ➖ noise
2 datafusion:vortex-compact -21.0% -4.9% -16.9% +40.0% ➖ noise
2 datafusion:vortex-file-compressed -21.2% -4.9% -17.2% +35.7% ➖ noise
2 duckdb:vortex-compact -2.4% -4.9% +2.6% +30.0% ➖ noise
2 duckdb:vortex-file-compressed -11.8% -4.9% -7.3% +31.9% ➖ noise
3 datafusion:vortex-compact +15.4% +7.5% +7.4% +48.6% ➖ noise
3 datafusion:vortex-file-compressed +0.9% +7.5% -6.1% +50.5% ➖ noise
3 duckdb:vortex-compact -11.9% +7.5% -18.0% +37.1% ➖ noise
3 duckdb:vortex-file-compressed -2.7% +7.5% -9.5% +49.1% ➖ noise
4 datafusion:vortex-compact -7.6% +4.4% -11.6% +41.1% ➖ noise
4 datafusion:vortex-file-compressed +9.4% +4.4% +4.8% +32.0% ➖ noise
4 duckdb:vortex-compact -13.8% +4.4% -17.5% +30.0% ➖ noise
4 duckdb:vortex-file-compressed -12.7% +4.4% -16.4% +30.0% ➖ noise
5 datafusion:vortex-compact +11.3% -5.5% +17.7% +30.0% ➖ noise
5 datafusion:vortex-file-compressed -6.9% -5.5% -1.5% +76.8% ➖ noise
5 duckdb:vortex-compact -18.6% -5.5% -13.9% +30.0% ➖ noise
5 duckdb:vortex-file-compressed -13.3% -5.5% -8.3% +30.0% ➖ noise
6 datafusion:vortex-compact -12.1% -6.9% -5.6% +30.0% ➖ noise
6 datafusion:vortex-file-compressed -4.8% -6.9% +2.3% +30.0% ➖ noise
6 duckdb:vortex-compact +1.7% -6.9% +9.2% +30.0% ➖ noise
6 duckdb:vortex-file-compressed +15.5% -6.9% +24.0% +30.0% ➖ noise
7 datafusion:vortex-compact +2.1% +6.9% -4.5% +30.0% ➖ noise
7 datafusion:vortex-file-compressed -9.9% +6.9% -15.8% +30.0% ➖ noise
7 duckdb:vortex-compact -12.7% +6.9% -18.4% +30.0% ➖ noise
7 duckdb:vortex-file-compressed -6.8% +6.9% -12.8% +30.0% ➖ noise
8 datafusion:vortex-compact -1.1% +1.1% -2.2% +30.0% ➖ noise
8 datafusion:vortex-file-compressed +9.4% +1.1% +8.2% +30.0% ➖ noise
8 duckdb:vortex-compact -5.2% +1.1% -6.2% +30.0% ➖ noise
8 duckdb:vortex-file-compressed -5.9% +1.1% -6.9% +30.0% ➖ noise
9 datafusion:vortex-compact -0.3% +6.2% -6.2% +30.0% ➖ noise
9 datafusion:vortex-file-compressed +9.9% +6.2% +3.5% +30.0% ➖ noise
9 duckdb:vortex-compact +0.9% +6.2% -5.0% +30.0% ➖ noise
9 duckdb:vortex-file-compressed -13.3% +6.2% -18.4% +30.0% ➖ noise
10 datafusion:vortex-compact -4.7% +6.2% -10.3% +30.0% ➖ noise
10 datafusion:vortex-file-compressed +9.4% +6.2% +3.0% +30.0% ➖ noise
10 duckdb:vortex-compact -14.3% +6.2% -19.4% +30.0% ➖ noise
10 duckdb:vortex-file-compressed -1.6% +6.2% -7.4% +30.0% ➖ noise
11 datafusion:vortex-compact +30.7% -0.2% +31.0% +30.7% 🚨 regression
11 datafusion:vortex-file-compressed +6.0% -0.2% +6.2% +33.6% ➖ noise
11 duckdb:vortex-compact -2.6% -0.2% -2.4% +30.0% ➖ noise
11 duckdb:vortex-file-compressed -1.1% -0.2% -0.9% +30.0% ➖ noise
12 datafusion:vortex-compact +5.7% -9.5% +16.8% +30.0% ➖ noise
12 datafusion:vortex-file-compressed +3.9% -9.5% +14.8% +30.0% ➖ noise
12 duckdb:vortex-compact -9.0% -9.5% +0.5% +32.3% ➖ noise
12 duckdb:vortex-file-compressed +1.0% -9.5% +11.5% +30.0% ➖ noise
13 datafusion:vortex-compact +2.6% -11.8% +16.3% +32.0% ➖ noise
13 datafusion:vortex-file-compressed -3.2% -11.8% +9.7% +30.0% ➖ noise
13 duckdb:vortex-compact -2.8% -11.8% +10.2% +40.1% ➖ noise
13 duckdb:vortex-file-compressed -15.1% -11.8% -3.8% +34.4% ➖ noise
14 datafusion:vortex-compact +2.3% +1.2% +1.1% +30.0% ➖ noise
14 datafusion:vortex-file-compressed -5.9% +1.2% -7.0% +30.0% ➖ noise
14 duckdb:vortex-compact -16.8% +1.2% -17.8% +30.0% ➖ noise
14 duckdb:vortex-file-compressed +0.2% +1.2% -1.0% +30.0% ➖ noise
15 datafusion:vortex-compact -12.6% -2.2% -10.6% +30.0% ➖ noise
15 datafusion:vortex-file-compressed -10.5% -2.2% -8.4% +30.0% ➖ noise
15 duckdb:vortex-compact -10.9% -2.2% -8.9% +30.0% ➖ noise
15 duckdb:vortex-file-compressed -21.9% -2.2% -20.2% +30.0% ➖ noise
16 datafusion:vortex-compact -2.0% +11.9% -12.5% +30.0% ➖ noise
16 datafusion:vortex-file-compressed -19.0% +11.9% -27.6% +30.0% ✅ faster
16 duckdb:vortex-compact -5.8% +11.9% -15.8% +30.0% ➖ noise
16 duckdb:vortex-file-compressed +7.8% +11.9% -3.6% +30.0% ➖ noise
17 datafusion:vortex-compact -0.6% +3.1% -3.6% +30.0% ➖ noise
17 datafusion:vortex-file-compressed -22.3% +3.1% -24.6% +30.0% ✅ faster
17 duckdb:vortex-compact -1.4% +3.1% -4.3% +30.0% ➖ noise
17 duckdb:vortex-file-compressed -8.3% +3.1% -11.0% +30.0% ➖ noise
18 datafusion:vortex-compact -6.4% -5.3% -1.1% +30.0% ➖ noise
18 datafusion:vortex-file-compressed -8.7% -5.3% -3.6% +30.0% ➖ noise
18 duckdb:vortex-compact -8.0% -5.3% -2.8% +30.0% ➖ noise
18 duckdb:vortex-file-compressed -7.4% -5.3% -2.2% +30.0% ➖ noise
19 datafusion:vortex-compact -10.1% -7.8% -2.5% +30.0% ➖ noise
19 datafusion:vortex-file-compressed -3.3% -7.8% +4.9% +30.0% ➖ noise
19 duckdb:vortex-compact -4.9% -7.8% +3.1% +30.0% ➖ noise
19 duckdb:vortex-file-compressed -11.1% -7.8% -3.6% +30.0% ➖ noise
20 datafusion:vortex-compact -7.5% -6.7% -0.8% +30.0% ➖ noise
20 datafusion:vortex-file-compressed +30.8% -6.7% +40.2% +31.0% 🚨 regression
20 duckdb:vortex-compact +1.9% -6.7% +9.2% +30.0% ➖ noise
20 duckdb:vortex-file-compressed +6.3% -6.7% +13.9% +30.0% ➖ noise
21 datafusion:vortex-compact -4.6% -3.4% -1.3% +30.0% ➖ noise
21 datafusion:vortex-file-compressed +26.0% -3.4% +30.4% +30.0% 🚨 regression
21 duckdb:vortex-compact -4.9% -3.4% -1.6% +30.0% ➖ noise
21 duckdb:vortex-file-compressed -2.2% -3.4% +1.2% +30.0% ➖ noise
22 datafusion:vortex-compact -8.7% -10.0% +1.5% +39.6% ➖ noise
22 datafusion:vortex-file-compressed -40.7% -10.0% -34.1% +30.0% ✅ faster
22 duckdb:vortex-compact +4.6% -10.0% +16.3% +30.0% ➖ noise
22 duckdb:vortex-file-compressed -4.0% -10.0% +6.7% +30.0% ➖ noise

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

changelog/break A breaking API change tldr

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@onursatici @joseph-isaacs