Comparing
sam-pyc
(9940f06
) withcanary
(96b6edb
)+48%
- Improvement
- 15
- Skipped
- 105
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
120 total
bench_lexer_only_simple
crates/baml_tests/benches/compiler_benchmark.rs+48%
24.3 µs16.4 µs
bench_scale_100_functions
/home/runner/_work/baml/baml/baml_language/target/release/build/baml_tests-1a35f8d6c5b313c2/out/generated_benchmarks.rs+25%
148 ms117.9 ms
bench_parse_only_simple
crates/baml_tests/benches/compiler_benchmark.rs+25%
36.8 µs29.5 µs
bench_incremental_no_change
crates/baml_tests/benches/compiler_benchmark.rs+22%
11.1 ms9.1 ms
bench_incremental_rename_type
/home/runner/_work/baml/baml/baml_language/target/release/build/baml_tests-1a35f8d6c5b313c2/out/generated_benchmarks.rs+22%
49.2 ms40.3 ms
bench_scale_deep_nesting
/home/runner/_work/baml/baml/baml_language/target/release/build/baml_tests-1a35f8d6c5b313c2/out/generated_benchmarks.rs+22%
37.4 ms30.8 ms
bench_incremental_close_string
/home/runner/_work/baml/baml/baml_language/target/release/build/baml_tests-1a35f8d6c5b313c2/out/generated_benchmarks.rs+17%
32.7 ms27.9 ms
bench_single_simple_file
crates/baml_tests/benches/compiler_benchmark.rs+17%
23.2 ms19.8 ms
bench_incremental_add_string_char
/home/runner/_work/baml/baml/baml_language/target/release/build/baml_tests-1a35f8d6c5b313c2/out/generated_benchmarks.rs+17%
32.8 ms28 ms
bench_incremental_add_user_field
/home/runner/_work/baml/baml/baml_language/target/release/build/baml_tests-1a35f8d6c5b313c2/out/generated_benchmarks.rs+17%
40.1 ms34.4 ms
bench_incremental_modify_function
crates/baml_tests/benches/compiler_benchmark.rs+15%
13.7 ms11.9 ms
bench_empty_project
crates/baml_tests/benches/compiler_benchmark.rs+12%
21.5 ms19.1 ms
bench_incremental_add_field
crates/baml_tests/benches/compiler_benchmark.rs+12%
13.8 ms12.3 ms
bench_incremental_add_attribute
/home/runner/_work/baml/baml/baml_language/target/release/build/baml_tests-1a35f8d6c5b313c2/out/generated_benchmarks.rs+11%
32.1 ms28.8 ms
bench_incremental_add_new_file
crates/baml_tests/benches/compiler_benchmark.rs+10%
18.5 ms16.8 ms
The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Learn more about archiving benchmarks
bench_incremental_add_user_field
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_incremental_add_attribute
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_scale_100_functions
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.4 ms*
bench_incremental_rename_type
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_incremental_add_string_char
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_scale_deep_nesting
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.4 ms*
bench_incremental_close_string
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_incremental_add_string_char
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rsSkipped
4 ms*
bench_scale_100_functions
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rsSkipped
4.1 ms*
bench_scale_deep_nesting
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rsSkipped
4.1 ms*
Commits
Click on a commit to change the comparison rangeBase
canary
96b6edb
+43.98%
fix rust unit tests for user. qualification
a4ca0f9
2 days ago
by sxlijin-0.09%
delete rig test empty
0e51528
2 days ago
by sxlijin-13.8%
codegen_python: render root __init__.py via askama template
5fe8071
2 days ago
by sxlijin+18.11%
fix CI: stow Cargo.toml, sync bridge_nodejs generated files, drop obsolete rig pre-commit hook
9940f06
2 days ago
by sxlijin