GitHub Actions run
Instrumentation
5 days ago acc8a4e masterCompare
Suggested base runs:
Benchmarks
test_llmfao_performance[counting-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[counting-pyo3]21.6 ms
test_llmfao_performance[elo-naive]
python/evalica/test_evalica.py::test_llmfao_performance[elo-naive]1.9 s
test_llmfao_performance[newman-naive]
python/evalica/test_evalica.py::test_llmfao_performance[newman-naive]34.5 ms
test_llmfao_performance[average_win_rate-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[average_win_rate-pyo3]21.8 ms
test_llmfao_performance[elo-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[elo-pyo3]22.9 ms
test_llmfao_performance[pagerank-naive]
python/evalica/test_evalica.py::test_llmfao_performance[pagerank-naive]25.4 ms
test_llmfao_pairwise_scores[naive]
python/evalica/test_evalica.py::test_llmfao_pairwise_scores[naive]245.9 µs
test_llmfao_performance[counting-naive]
python/evalica/test_evalica.py::test_llmfao_performance[counting-naive]36.4 ms
test_llmfao_pairwise_scores[pyo3]
python/evalica/test_evalica.py::test_llmfao_pairwise_scores[pyo3]108.2 µs
test_llmfao_matrices
python/evalica/test_evalica.py::test_llmfao_matrices3 ms
test_llmfao_performance[bradley_terry-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[bradley_terry-pyo3]22.1 ms
test_llmfao_performance[average_win_rate-naive]
python/evalica/test_evalica.py::test_llmfao_performance[average_win_rate-naive]23.8 ms
test_llmfao_performance[eigen-naive]
python/evalica/test_evalica.py::test_llmfao_performance[eigen-naive]26.3 ms
test_llmfao_performance[pagerank-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[pagerank-pyo3]22 ms
test_llmfao_performance[newman-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[newman-pyo3]25.9 ms
test_llmfao_performance[eigen-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[eigen-pyo3]22.2 ms
test_llmfao_performance[bradley_terry-naive]
python/evalica/test_evalica.py::test_llmfao_performance[bradley_terry-naive]42.9 ms
test_llmfao_indexing
python/evalica/test_evalica.py::test_llmfao_indexing15.6 ms