Comparing
sam/rp24
(99d30ba
) withcanary
(d2a1559
)+27%
- Improvement
- 3
- Untouched
- 12
- Skipped
- 49
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Benchmarks
64 total
bench_incremental_add_attribute
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs+27%
96 µs75.4 µs
bench_empty_project
crates/baml_tests/benches/compiler_benchmark.rs+21%
34.8 µs28.7 µs
bench_scale_100_functions
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs+13%
765.4 µs679.3 µs
bench_single_simple_file
crates/baml_tests/benches/compiler_benchmark.rs+10%
65.5 µs59.7 µs
bench_incremental_close_string
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs+7%
54.6 µs51.1 µs
bench_scale_deep_nesting
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs+7%
437.5 µs409.8 µs
bench_incremental_add_string_char
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs+6%
54.2 µs50.9 µs
bench_incremental_add_user_field
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs+5%
133.8 µs127 µs
bench_incremental_modify_function
crates/baml_tests/benches/compiler_benchmark.rs+5%
45.1 µs42.9 µs
bench_incremental_add_field
crates/baml_tests/benches/compiler_benchmark.rs+4%
46.5 µs44.6 µs
bench_lexer_only_simple
crates/baml_tests/benches/compiler_benchmark.rs+4%
36.1 µs34.7 µs
bench_incremental_add_new_file
crates/baml_tests/benches/compiler_benchmark.rs+4%
44.6 µs42.9 µs
bench_parse_only_simple
crates/baml_tests/benches/compiler_benchmark.rs0%
60.4 µs60.1 µs
bench_incremental_rename_type
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs-1%
232.1 µs234.2 µs
bench_incremental_no_change
crates/baml_tests/benches/compiler_benchmark.rs-2%
10.1 µs10.3 µs
The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Learn more about archiving benchmarks
bench_incremental_add_user_field
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_incremental_add_attribute
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_scale_100_functions
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.4 ms*
bench_incremental_rename_type
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_incremental_add_string_char
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_scale_deep_nesting
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.4 ms*
bench_incremental_close_string
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_incremental_add_string_char
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rsSkipped
4 ms*
bench_scale_100_functions
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rsSkipped
4.1 ms*
bench_scale_deep_nesting
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rsSkipped
4.1 ms*
Commits
Click on a commit to change the comparison rangeBase
canary
d2a1559
-0.13%
baml-language: implement render_prompt llmcall
e900141
21 hours ago
by sxlijin-0.82%
Merge branch 'canary' into sam/rp24
f636ce1
4 hours ago
by antoniosarosi+28.36%
Update snapshot for Llm(RenderPrompt) change
99d30ba
4 hours ago
by antoniosarosi