alpha - Branch - dustalov/evalica - CodSpeed

Blog Docs Changelog

Add Krippendorff's alpha bootstrapping

#72Merged

Comparing

alpha

(

b33f5af

) with

master

(

7f1be50

)

+1%

Untouched: 26

Benchmarks

26 total

test_alpha_performance[ratio-naive]

python/evalica/test_alpha.py

+5%

4.3 ms4.1 ms

test_alpha_performance[ordinal-naive]

python/evalica/test_alpha.py

+5%

4.3 ms4.1 ms

test_alpha_performance[interval-naive]

python/evalica/test_alpha.py

+5%

4.3 ms4.1 ms

test_alpha_performance[nominal-naive]

python/evalica/test_alpha.py

+5%

4.5 ms4.2 ms

test_llmfao_performance[eigen-naive]

python/evalica/test_pairwise.py

+1%

31 ms30.8 ms

test_llmfao_performance[elo-naive]

python/evalica/test_pairwise.py

0%

1.8 s1.8 s

test_llmfao_matrices

python/evalica/test_pairwise.py

0%

2.6 ms2.6 ms

test_llmfao_performance[newman-naive]

python/evalica/test_pairwise.py

0%

39 ms38.9 ms

test_llmfao_performance[counting-naive]

python/evalica/test_pairwise.py

0%

23.8 ms23.8 ms

test_llmfao_pairwise_scores[pyo3]

python/evalica/test_pairwise.py

0%

94.3 µs94.3 µs

test_llmfao_performance[bradley_terry-naive]

python/evalica/test_pairwise.py

0%

47.1 ms47.1 ms

test_llmfao_indexing

python/evalica/test_pairwise.py

0%

9.7 ms9.7 ms

test_llmfao_performance[bradley_terry-pyo3]

python/evalica/test_pairwise.py

0%

10.7 ms10.7 ms

test_llmfao_performance[average_win_rate-pyo3]

python/evalica/test_pairwise.py

0%

10.6 ms10.6 ms

test_llmfao_performance[pagerank-pyo3]

python/evalica/test_pairwise.py

0%

10.7 ms10.7 ms

test_llmfao_performance[eigen-pyo3]

python/evalica/test_pairwise.py

0%

10.8 ms10.8 ms

test_llmfao_pairwise_scores[naive]

python/evalica/test_pairwise.py

0%

235.9 µs236 µs

test_llmfao_performance[elo-pyo3]

python/evalica/test_pairwise.py

0%

11.6 ms11.6 ms

test_llmfao_performance[average_win_rate-naive]

python/evalica/test_pairwise.py

0%

28.5 ms28.5 ms

test_llmfao_performance[newman-pyo3]

python/evalica/test_pairwise.py

0%

14.5 ms14.5 ms

test_llmfao_performance[pagerank-naive]

python/evalica/test_pairwise.py

0%

29.9 ms30 ms

test_llmfao_performance[counting-pyo3]

python/evalica/test_pairwise.py

0%

10.3 ms10.3 ms

test_alpha_performance[nominal-pyo3]

python/evalica/test_alpha.py

0%

3.8 ms3.8 ms

test_alpha_performance[ordinal-pyo3]

python/evalica/test_alpha.py

0%

3.8 ms3.8 ms

test_alpha_performance[ratio-pyo3]

python/evalica/test_alpha.py

0%

3.8 ms3.8 ms

Commits

Click on a commit to change the comparison range

Base

master

7f1be50

+0.78%

Fix tests

b33f5af

2 days ago

by dustalov

© 2026 CodSpeed Technology

Home Terms Privacy Docs