chore: Stabilize benchmarks for better signal
#3370Comparing
larseggert:chore-bench-stabilization
(ed64ad6
) withmain
(6a84421
)-5%
- Improvement
- 2
- Regression
- 2
- Untouched
- 28
- Dropped
- 19
Benchmarks
51 total
neqo-neqo-newreno-nopacing
exec_harnessMissing
N/A
293.1 msN/A
neqo-neqo-newreno
exec_harnessMissing
N/A
296.9 msN/A
quiche-neqo
exec_harnessMissing
N/A
388.8 msN/A
neqo-s2n
exec_harnessMissing
N/A
603.1 msN/A
neqo-msquic
exec_harnessMissing
N/A
1.1 sN/A
google-google
exec_harnessMissing
N/A
1.2 sN/A
neqo-google
exec_harnessMissing
N/A
1.6 sN/A
quiche-quiche
exec_harnessMissing
N/A
359.1 msN/A
s2n-s2n
exec_harnessMissing
N/A
661.4 msN/A
neqo-quiche
exec_harnessMissing
N/A
459.2 msN/A
1-conn/10_000-parallel-1b-resp (aka. RPS)
neqo-bin/benches/main.rs::benches::transfer::transferMissing
N/A
569.9 msN/A
1-conn/1-100mb-req (aka. Upload)
neqo-bin/benches/main.rs::benches::transfer::transferMissing
N/A
590.6 msN/A
1-conn/1-100mb-resp (aka. Download)
neqo-bin/benches/main.rs::benches::transfer::transferMissing
N/A
419.6 msN/A
1-conn/1-1b-resp (aka. HPS)
neqo-bin/benches/main.rs::benches::transfer::transferMissing
N/A
55.7 msN/A
neqo-neqo-cubic
exec_harnessMissing
N/A
296.3 msN/A
walltime/pacing-true/same-seed
neqo-transport/benches/transfer_walltime.rs::transfer::benchmark::transferMissing
N/A
129.4 msN/A
walltime/pacing-true/varying-seeds
neqo-transport/benches/transfer_walltime.rs::transfer::benchmark::transferMissing
N/A
128.3 msN/A
walltime/pacing-false/varying-seeds
neqo-transport/benches/transfer_walltime.rs::transfer::benchmark::transferMissing
N/A
130.7 msN/A
walltime/pacing-false/same-seed
neqo-transport/benches/transfer_walltime.rs::transfer::benchmark::transferMissing
N/A
130.3 msN/A
msquic-msquic
exec_harness-6%
456 ms484.7 ms
walltime/1-streams/each-1000-bytes
neqo-http3/benches/streams_walltime.rs::benches::benchmark::streams-5%
1.4 ms1.4 ms
neqo-neqo-cubic-nopacing
exec_harness+7%
295.9 ms277.4 ms
msquic-neqo
exec_harness+4%
426 ms411.1 ms
s2n-neqo
exec_harness+1%
481.7 ms478.3 ms
take_ranges
neqo-transport/benches/sent_packets.rs::benches::take_ranges::sent::Packets0%
29.7 µs29.6 µs
Commits
Click on a commit to change the comparison rangeBase
main
6a84421
-5.04%
chore: Stabilize benchmarks for better signal
fbbcbbd
3 months ago
by larseggert+0.51%
Merge branch 'main' into chore-bench-stabilization
ed64ad6
2 months ago
by larseggert