Comparing
paulo/optional-function-parameters
(e5aa6e2
) withcanary
(7a03331
)+67%
- Improvement
- 14
- Untouched
- 5
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.No successful run was found on canary ( 6397873) during the generation of this report, so 7a03331 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
19 total
vm_mixed_ops
crates/baml_tests/benches/runtime_benchmark.rs+67%
21.5 ms12.8 ms
e2e_hello_world
crates/baml_tests/benches/runtime_benchmark.rs+27%
157.7 ms124.3 ms
e2e_class_and_loop
crates/baml_tests/benches/runtime_benchmark.rs+27%
160.9 ms126.9 ms
startup_empty_expression
crates/baml_tests/benches/runtime_benchmark.rs+27%
157.3 ms124.2 ms
e2e_arithmetic
crates/baml_tests/benches/runtime_benchmark.rs+27%
157.6 ms124.5 ms
compile_to_engine
crates/baml_tests/benches/runtime_benchmark.rs+26%
156.7 ms124 ms
e2e_fib_20
crates/baml_tests/benches/runtime_benchmark.rs+26%
161.7 ms128.1 ms
e2e_100_functions
crates/baml_tests/benches/runtime_benchmark.rs+25%
250.8 ms200.3 ms
vm_loop_500k
crates/baml_tests/benches/runtime_benchmark.rs+25%
37.3 ms29.8 ms
vm_field_access_50k
crates/baml_tests/benches/runtime_benchmark.rs+18%
10.8 ms9.1 ms
vm_fib_20
crates/baml_tests/benches/runtime_benchmark.rs+15%
8.8 ms7.7 ms
vm_closure_call_50k
crates/baml_tests/benches/runtime_benchmark.rs+15%
13.8 ms12 ms
vm_call_chain_100_x_5k
crates/baml_tests/benches/runtime_benchmark.rs+14%
53.2 ms46.7 ms
vm_nested_loop
crates/baml_tests/benches/runtime_benchmark.rs+13%
8.4 ms7.5 ms
vm_array_iter_10k
crates/baml_tests/benches/runtime_benchmark.rs+10%
8.7 ms7.9 ms
vm_class_create_50k
crates/baml_tests/benches/runtime_benchmark.rs+10%
18.3 ms16.7 ms
engine_init_cost
crates/baml_tests/benches/runtime_benchmark.rs+8%
5.6 ms5.2 ms
vm_array_push_50k
crates/baml_tests/benches/runtime_benchmark.rs+7%
13.4 ms12.5 ms
vm_string_concat_5k
crates/baml_tests/benches/runtime_benchmark.rs+3%
49.3 ms47.9 ms
Commits
Click on a commit to change the comparison rangeBase
canary
7a03331
+67.49%
Merge branch 'canary' into paulo/optional-function-parameters
e5aa6e2
7 days ago
by rossirpaulo