Comparing
push-nkwmzmrkktvy
(02c7bab
) withcanary
(460b77c
)-44%
- Regression
- 7
- Untouched
- 12
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
19 total
vm_mixed_ops
crates/baml_tests/benches/runtime_benchmark.rs-44%
13.8 ms24.5 ms
engine_init_cost
crates/baml_tests/benches/runtime_benchmark.rs-25%
4.5 ms6.1 ms
vm_string_concat_5k
crates/baml_tests/benches/runtime_benchmark.rs-15%
49.6 ms58.7 ms
vm_fib_20
crates/baml_tests/benches/runtime_benchmark.rs-13%
7.7 ms8.9 ms
vm_array_iter_10k
crates/baml_tests/benches/runtime_benchmark.rs-13%
7.6 ms8.8 ms
vm_closure_call_50k
crates/baml_tests/benches/runtime_benchmark.rs-10%
12.9 ms14.3 ms
vm_field_access_50k
crates/baml_tests/benches/runtime_benchmark.rs-10%
9.8 ms10.9 ms
e2e_arithmetic
crates/baml_tests/benches/runtime_benchmark.rs+5%
146.6 ms140.3 ms
e2e_class_and_loop
crates/baml_tests/benches/runtime_benchmark.rs+4%
149.9 ms143.8 ms
e2e_100_functions
crates/baml_tests/benches/runtime_benchmark.rs+4%
238.6 ms229.5 ms
e2e_hello_world
crates/baml_tests/benches/runtime_benchmark.rs+3%
144.3 ms140.4 ms
e2e_fib_20
crates/baml_tests/benches/runtime_benchmark.rs+2%
149.1 ms145.5 ms
compile_to_engine
crates/baml_tests/benches/runtime_benchmark.rs+2%
142.1 ms139.6 ms
startup_empty_expression
crates/baml_tests/benches/runtime_benchmark.rs+1%
144.6 ms143.3 ms
vm_loop_500k
crates/baml_tests/benches/runtime_benchmark.rs0%
36.2 ms36.2 ms
vm_array_push_50k
crates/baml_tests/benches/runtime_benchmark.rs-5%
12.4 ms13.1 ms
vm_nested_loop
crates/baml_tests/benches/runtime_benchmark.rs-9%
7.4 ms8.1 ms
vm_call_chain_100_x_5k
crates/baml_tests/benches/runtime_benchmark.rs-9%
51.8 ms56.7 ms
vm_class_create_50k
crates/baml_tests/benches/runtime_benchmark.rs-10%
17.2 ms19.1 ms
Commits
Click on a commit to change the comparison rangeBase
canary
460b77c
-43.79%
chore(sdk_tests): extract shared build.rs into sdk_test_build crate
02c7bab
11 days ago
by sxlijin