GitHub Actions run
Instrumentation
11 days ago bc81edb masterCompare
Suggested base runs:
Benchmarks
test_llmfao_matrices
python/evalica/test_evalica.py::test_llmfao_matrices6 ms
test_llmfao_performance[counting-naive]
python/evalica/test_evalica.py::test_llmfao_performance[counting-naive]40 ms
test_llmfao_performance[eigen-naive]
python/evalica/test_evalica.py::test_llmfao_performance[eigen-naive]28.5 ms
test_llmfao_performance[elo-naive]
python/evalica/test_evalica.py::test_llmfao_performance[elo-naive]1.8 s
test_llmfao_pairwise_scores[naive]
python/evalica/test_evalica.py::test_llmfao_pairwise_scores[naive]258.4 µs
test_llmfao_performance[newman-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[newman-pyo3]28.6 ms
test_llmfao_performance[eigen-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[eigen-pyo3]24.8 ms
test_llmfao_performance[pagerank-naive]
python/evalica/test_evalica.py::test_llmfao_performance[pagerank-naive]27.9 ms
test_llmfao_performance[pagerank-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[pagerank-pyo3]24.7 ms
test_llmfao_indexing
python/evalica/test_evalica.py::test_llmfao_indexing15.6 ms
test_llmfao_performance[bradley_terry-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[bradley_terry-pyo3]24.8 ms
test_llmfao_pairwise_scores[pyo3]
python/evalica/test_evalica.py::test_llmfao_pairwise_scores[pyo3]107.9 µs
test_llmfao_performance[counting-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[counting-pyo3]24.4 ms
test_llmfao_performance[elo-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[elo-pyo3]25.5 ms
test_llmfao_performance[average_win_rate-naive]
python/evalica/test_evalica.py::test_llmfao_performance[average_win_rate-naive]26.6 ms
test_llmfao_performance[bradley_terry-naive]
python/evalica/test_evalica.py::test_llmfao_performance[bradley_terry-naive]45.3 ms
test_llmfao_performance[newman-naive]
python/evalica/test_evalica.py::test_llmfao_performance[newman-naive]38 ms
test_llmfao_performance[average_win_rate-pyo3]
python/evalica/test_evalica.py::test_llmfao_performance[average_win_rate-pyo3]24.5 ms