Comparing
feat/pareto-slices-leaderboard
(3213c8c
) withmain
(65558b5
)0%
- Untouched
- 41
- Skipped
- 10
No successful run was found on main ( e474ef6) during the generation of this report, so 65558b5 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
51 total
fed_prox[tiny]
vfl-core/benches/aggregate.rs+1%
58.1 µs57.4 µs
test_rust_global_weights[tiny]
tests/bench/test_round_speed.py+1%
31.6 µs31.4 µs
test_rust_aggregate[medium-FedMedian]
tests/bench/test_round_speed.py+1%
202.1 ms201 ms
test_rust_aggregate[medium-TrimmedMean]
tests/bench/test_round_speed.py0%
251.6 ms250.5 ms
multi_krum[tiny]
vfl-core/benches/aggregate.rs0%
228.8 µs227.9 µs
fed_median[medium]
vfl-core/benches/aggregate.rs0%
212.2 ms212 ms
bulyan[medium]
vfl-core/benches/aggregate.rs0%
518.6 ms518.1 ms
test_rust_aggregate[medium-Bulyan]
tests/bench/test_round_speed.py0%
515.4 ms515.2 ms
trimmed_mean[tiny]
vfl-core/benches/aggregate.rs0%
259.8 µs259.8 µs
krum[tiny]
vfl-core/benches/aggregate.rs0%
215.6 µs215.5 µs
trimmed_mean[medium]
vfl-core/benches/aggregate.rs0%
263.3 ms263.3 ms
trimmed_mean[large]
vfl-core/benches/aggregate.rs0%
2.6 s2.6 s
fed_median[tiny]
vfl-core/benches/aggregate.rs0%
212.1 µs212.1 µs
test_rust_aggregate[tiny-TrimmedMean]
tests/bench/test_round_speed.py0%
279.9 µs279.9 µs
fed_prox[medium]
vfl-core/benches/aggregate.rs0%
42.4 ms42.4 ms
test_rust_aggregate[medium-FedAvg]
tests/bench/test_round_speed.py0%
42.4 ms42.4 ms
bulyan[large]
vfl-core/benches/aggregate.rs0%
5.6 s5.6 s
fed_avg[large]
vfl-core/benches/aggregate.rs0%
422.3 ms422.3 ms
multi_krum[large]
vfl-core/benches/aggregate.rs0%
3.8 s3.8 s
test_rust_aggregate[medium-Krum]
tests/bench/test_round_speed.py0%
324.8 ms324.8 ms
test_rust_aggregate[medium-ArKrum]
tests/bench/test_round_speed.py0%
342.9 ms342.9 ms
multi_krum[medium]
vfl-core/benches/aggregate.rs0%
352.4 ms352.4 ms
krum[large]
vfl-core/benches/aggregate.rs0%
3.6 s3.6 s
test_rust_aggregate[medium-FedProx]
tests/bench/test_round_speed.py0%
42.4 ms42.4 ms
test_rust_aggregate[medium-MultiKrum]
tests/bench/test_round_speed.py0%
352.4 ms352.4 ms
Commits
Click on a commit to change the comparison rangeBase
main
65558b5
-0.11%
feat(leaderboard): pareto-slices — frontier per (dataset x attack)
3213c8c
3 days ago
by ajbarea