GitHub Actions run
Instrumentation
14 days ago 3e26613 master pushCompare
Suggested base runs:
Benchmarks
test_llmfao_performance[newman-naive]
python/evalica/test_evalica.py::test_llmfao_performance[newman-naive]34.4 ms
test_llmfao_performance[elo-naive]
python/evalica/test_evalica.py::test_llmfao_performance[elo-naive]1.8 s
test_llmfao_performance[newman-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[newman-pyo3]25.9 ms
test_llmfao_pairwise_scores[naive]
python/evalica/test_evalica.py::test_llmfao_pairwise_scores[naive]245.9 µs
test_llmfao_performance[average_win_rate-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[average_win_rate-pyo3]22 ms
test_llmfao_performance[elo-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[elo-pyo3]22.8 ms
test_llmfao_pairwise_scores[pyo3]
python/evalica/test_evalica.py::test_llmfao_pairwise_scores[pyo3]109 µs
test_llmfao_performance[eigen-naive]
python/evalica/test_evalica.py::test_llmfao_performance[eigen-naive]26.2 ms
test_llmfao_performance[bradley_terry-naive]
python/evalica/test_evalica.py::test_llmfao_performance[bradley_terry-naive]42.6 ms
test_llmfao_indexing
python/evalica/test_evalica.py::test_llmfao_indexing15.7 ms
test_llmfao_performance[bradley_terry-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[bradley_terry-pyo3]22.1 ms
test_llmfao_performance[pagerank-naive]
python/evalica/test_evalica.py::test_llmfao_performance[pagerank-naive]25.4 ms
test_llmfao_performance[pagerank-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[pagerank-pyo3]22 ms
test_llmfao_performance[eigen-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[eigen-pyo3]22.1 ms
test_llmfao_matrices
python/evalica/test_evalica.py::test_llmfao_matrices3 ms
test_llmfao_performance[counting-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[counting-pyo3]21.6 ms
test_llmfao_performance[average_win_rate-naive]
python/evalica/test_evalica.py::test_llmfao_performance[average_win_rate-naive]23.9 ms
test_llmfao_performance[counting-naive]
python/evalica/test_evalica.py::test_llmfao_performance[counting-naive]36.6 ms