Factorize binding representations
#857Comparing
yihozhang-factorized-bindings
(367e275
) withclaude-experiment
(48bfe1a
)+26%
- Improvement
- 22
- Untouched
- 24
- New
- 4
- Skipped
- 190
No successful run was found on claude-experiment ( 6e75cef) during the generation of this report, so 6a7904f was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
240 total
tests[cykjson]
benches/ci_benchmarking.rs+88%
500.1 ms265.5 ms
tests[cykjson]
benches/ci_benchmarking.rs+83%
357.8 ms195.7 ms
rust_rule_fib[rule_run_1000]
benches/rust_api_benchmarking.rs+70%
337.9 ms198.6 ms
rust_rule_fib[rule_run_1000]
benches/rust_api_benchmarking.rs+63%
244.6 ms150.4 ms
tests[python_array_optimize]
benches/ci_benchmarking.rs+52%
2.3 s1.5 s
tests[python_array_optimize]
benches/ci_benchmarking.rs+41%
2.3 s1.6 s
tests[hardboiled_conv1d_128]
benches/ci_benchmarking.rs+38%
3.9 s2.9 s
tests[hardboiled_conv1d_128]
benches/ci_benchmarking.rs+37%
3.3 s2.4 s
tests[hardboiled_conv1d_32]
benches/ci_benchmarking.rs+23%
1,150 ms933.3 ms
tests[hardboiled_conv1d_32]
benches/ci_benchmarking.rs+21%
1,029.2 ms849.4 ms
rust_rule_match_overhead[rule_run_1]
benches/rust_api_benchmarking.rs+19%
9.4 ms7.9 ms
rust_rule_match_overhead[rule_run_1]
benches/rust_api_benchmarking.rs+19%
14.9 ms12.6 ms
tests[herbie]
benches/ci_benchmarking.rs+9%
172.9 ms158 ms
rust_rule_tableaction_hot_path[facts50000_funcs200]
benches/rust_api_benchmarking.rs+9%
36.8 ms33.6 ms
tests[proof_testing_eqsat-basic]
benches/ci_benchmarking.rs+9%
28.9 ms26.5 ms
tests[typeinfer]
benches/ci_benchmarking.rs+7%
133.1 ms124.7 ms
tests[herbie]
benches/ci_benchmarking.rs+6%
193.1 ms182.2 ms
tests[math-microbenchmark]
benches/ci_benchmarking.rs+6%
8.2 s7.8 s
rust_rule_tableaction_hot_path[facts50000_funcs200]
benches/rust_api_benchmarking.rs+6%
29 ms27.5 ms
tests[extract-vec-bench]
benches/ci_benchmarking.rs+5%
82.8 ms78.5 ms
tests[proof_testing_unify]
benches/ci_benchmarking.rs+5%
18.6 ms17.6 ms
tests[typeinfer]
benches/ci_benchmarking.rs+5%
109.8 ms104.3 ms
tests[eggcc-2mm]
benches/ci_benchmarking.rsN/A
N/A9.7 s
tests[eggcc-2mm]
benches/ci_benchmarking.rsN/A
N/A7.7 s
tests[factoring-multisets]
benches/ci_benchmarking.rsN/A
N/A67.4 ms
Commits
Click on a commit to change the comparison rangeBase
claude-experiment
48bfe1a
+25.84%
fix build
367e275
4 days ago
by yihozhang