push-ywwxtlyvkryv - Branch - BoundaryML/baml

baml-language: llm media resolution

#3064

Comparing

push-ywwxtlyvkryv

(

08a8f9a

) with

canary

(

2f8e56d

)

-38%

Regression: 4

Untouched: 11

Skipped: 56

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Benchmarks

71 total

bench_incremental_close_string

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-d39dde26a7a58f76/out/generated_benchmarks.rs

-38%

55.7 µs89.3 µs

bench_incremental_modify_function

crates/baml_tests/benches/compiler_benchmark.rs

-27%

57.4 µs78.6 µs

bench_incremental_no_change

crates/baml_tests/benches/compiler_benchmark.rs

-23%

18.2 µs23.7 µs

bench_incremental_add_user_field

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-d39dde26a7a58f76/out/generated_benchmarks.rs

-19%

156 µs192.6 µs

bench_incremental_add_new_file

crates/baml_tests/benches/compiler_benchmark.rs

+1%

71.7 µs70.8 µs

bench_parse_only_simple

crates/baml_tests/benches/compiler_benchmark.rs

61.6 µs61.5 µs

bench_incremental_rename_type

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-d39dde26a7a58f76/out/generated_benchmarks.rs

-1%

242.7 µs244.1 µs

bench_scale_deep_nesting

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-d39dde26a7a58f76/out/generated_benchmarks.rs

-1%

441.3 µs446.1 µs

bench_scale_100_functions

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-d39dde26a7a58f76/out/generated_benchmarks.rs

-1%

784.1 µs795.4 µs

bench_incremental_add_attribute

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-d39dde26a7a58f76/out/generated_benchmarks.rs

-1%

87.9 µs89.2 µs

bench_single_simple_file

crates/baml_tests/benches/compiler_benchmark.rs

-2%

64.5 µs65.8 µs

bench_empty_project

crates/baml_tests/benches/compiler_benchmark.rs

-2%

21.1 µs21.5 µs

bench_lexer_only_simple

crates/baml_tests/benches/compiler_benchmark.rs

-2%

35.3 µs36.1 µs

bench_incremental_add_field

crates/baml_tests/benches/compiler_benchmark.rs

-3%

67 µs68.9 µs

bench_incremental_add_string_char

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-d39dde26a7a58f76/out/generated_benchmarks.rs

-4%

88.1 µs91.4 µs

The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks

bench_incremental_add_user_field

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.3 ms*

bench_incremental_add_attribute

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.3 ms*

bench_scale_100_functions

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.4 ms*

bench_incremental_rename_type

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.3 ms*

bench_incremental_add_string_char

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.3 ms*

bench_scale_deep_nesting

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.4 ms*

bench_incremental_close_string

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.3 ms*

bench_incremental_add_string_char

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rs

Skipped

4 ms*

bench_scale_100_functions

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rs

Skipped

4.1 ms*

bench_scale_deep_nesting

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rs

Skipped

4.1 ms*

Commits

Click on a commit to change the comparison range

Base

canary

2f8e56d

-37.65%

baml-language: llm media resolution

08a8f9a

4 days ago

by sxlijin

Home Terms Privacy Docs