Comparing
hellovai/fix-benchmarks
(16475d4
) withcanary
(d393c6f
)-53%
- Archived
- 20
No successful run was found on canary ( c3b383c) during the generation of this report, so d393c6f was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
This report only contains results for the Wall Time instrument. To view results for the CPU Simulation instrument, click here.
Benchmarks
20 total
The benchmarks below were run, but are now archived.
If they were deleted in another branch, consider rebasing to remove them from the report.
If they were added back in this branch, you can restore them to include them in future performance reports.
Learn more about archiving benchmarks
If they were deleted in another branch, consider rebasing to remove them from the report.
If they were added back in this branch, you can restore them to include them in future performance reports.
Learn more about archiving benchmarks
vm_array_push_50k
crates/baml_tests/benches/runtime_benchmark.rsArchived
-62%
8.9 ms23.5 ms
vm_string_concat_5k
crates/baml_tests/benches/runtime_benchmark.rsArchived
×6.7
27.1 ms4.1 ms
vm_closure_call_50k
crates/baml_tests/benches/runtime_benchmark.rsArchived
-63%
8.4 ms22.7 ms
vm_mixed_ops
crates/baml_tests/benches/runtime_benchmark.rsArchived
-45%
5.9 ms10.7 ms
vm_nested_loop
crates/baml_tests/benches/runtime_benchmark.rsArchived
-50%
4.9 ms9.9 ms
vm_field_access_50k
crates/baml_tests/benches/runtime_benchmark.rsArchived
-61%
6.7 ms17.1 ms
vm_class_create_50k
crates/baml_tests/benches/runtime_benchmark.rsArchived
-68%
12.5 ms38.9 ms
vm_fib_20
crates/baml_tests/benches/runtime_benchmark.rsArchived
-31%
5.7 ms8.2 ms
vm_call_chain_100_x_5k
crates/baml_tests/benches/runtime_benchmark.rsArchived
-75%
35.1 ms142.9 ms
vm_loop_500k
crates/baml_tests/benches/runtime_benchmark.rsArchived
-82%
21.1 ms117.7 ms
vm_wide_nested_class_create_50k
crates/baml_tests/benches/runtime_benchmark.rsArchived
N/A
N/A300.9 ms
vm_array_iter_10k
crates/baml_tests/benches/runtime_benchmark.rsArchived
-33%
5.2 ms7.8 ms
engine_init_cost
crates/baml_tests/benches/runtime_benchmark.rsArchived
-81%
3.3 ms17.3 ms
compile_to_engine
crates/baml_tests/benches/runtime_benchmark.rsArchived
0%
96.9 ms96.9 ms*
startup_empty_expression
crates/baml_tests/benches/runtime_benchmark.rsArchived
0%
98.9 ms98.9 ms*
e2e_hello_world
crates/baml_tests/benches/runtime_benchmark.rsArchived
0%
97.3 ms97.3 ms*
e2e_arithmetic
crates/baml_tests/benches/runtime_benchmark.rsArchived
0%
95.8 ms95.8 ms*
e2e_class_and_loop
crates/baml_tests/benches/runtime_benchmark.rsArchived
0%
100.8 ms100.8 ms*
e2e_100_functions
crates/baml_tests/benches/runtime_benchmark.rsArchived
0%
153.2 ms153.2 ms*
e2e_fib_20
crates/baml_tests/benches/runtime_benchmark.rsArchived
0%
99.2 ms99.2 ms*
Commits
Click on a commit to change the comparison rangeBase
canary
d393c6f
-50.34%
perf(bench): compile + build tokio runtime once in vm_* runtime benches
cf3c725
2 months ago
by hellovai-0.92%
ci: TEMP seed linux-arm-bench on this branch to validate run-job cache
7ba0f0f
2 months ago
by hellovai+0.84%
ci: pass cargo home via artifact, not cache (cache misses across runners)
29bfa19
2 months ago
by hellovai-2.31%
ci: slim cargo-home artifact (exclude registry/src)
16475d4
2 months ago
by hellovai