GitHub Actions run
Instrumentation
12 days ago e992839 masterCompare
Suggested base runs:
Benchmarks
test_llmfao_performance[counting-naive]
python/evalica/test_evalica.py::test_llmfao_performance[counting-naive]39.9 ms
test_llmfao_performance[average_win_rate-naive]
python/evalica/test_evalica.py::test_llmfao_performance[average_win_rate-naive]27 ms
test_llmfao_matrices
python/evalica/test_evalica.py::test_llmfao_matrices6 ms
test_llmfao_performance[counting-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[counting-pyo3]24.8 ms
test_llmfao_performance[average_win_rate-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[average_win_rate-pyo3]25 ms
test_llmfao_indexing
python/evalica/test_evalica.py::test_llmfao_indexing15.5 ms
test_llmfao_performance[bradley_terry-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[bradley_terry-pyo3]25.1 ms
test_llmfao_performance[elo-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[elo-pyo3]25.8 ms
test_llmfao_performance[pagerank-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[pagerank-pyo3]25.2 ms
test_llmfao_performance[newman-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[newman-pyo3]28.9 ms
test_llmfao_performance[pagerank-naive]
python/evalica/test_evalica.py::test_llmfao_performance[pagerank-naive]28.2 ms
test_llmfao_pairwise_scores[naive]
python/evalica/test_evalica.py::test_llmfao_pairwise_scores[naive]262.2 µs
test_llmfao_performance[newman-naive]
python/evalica/test_evalica.py::test_llmfao_performance[newman-naive]38.3 ms
test_llmfao_performance[eigen-naive]
python/evalica/test_evalica.py::test_llmfao_performance[eigen-naive]29 ms
test_llmfao_performance[eigen-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[eigen-pyo3]25.3 ms
test_llmfao_performance[elo-naive]
python/evalica/test_evalica.py::test_llmfao_performance[elo-naive]1.8 s
test_llmfao_pairwise_scores[pyo3]
python/evalica/test_evalica.py::test_llmfao_pairwise_scores[pyo3]108.2 µs
test_llmfao_performance[bradley_terry-naive]
python/evalica/test_evalica.py::test_llmfao_performance[bradley_terry-naive]45.7 ms