Implement BEP-009 streaming primitives
#3215Comparing
bep009-streaming-implementation
(34ca454
) withcanary
(f32fa20
)-33%
- Regression
- 13
- Untouched
- 2
- Skipped
- 91
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Benchmarks
106 total
bench_empty_project
crates/baml_tests/benches/compiler_benchmark.rs-33%
905.8 µs1,354.8 µs
bench_single_simple_file
crates/baml_tests/benches/compiler_benchmark.rs-31%
996.8 µs1,441.1 µs
bench_incremental_add_string_char
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-40d16841fce86f18/out/generated_benchmarks.rs-31%
985.3 µs1,424.2 µs
bench_incremental_add_attribute
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-40d16841fce86f18/out/generated_benchmarks.rs-31%
985.5 µs1,424.2 µs
bench_incremental_close_string
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-40d16841fce86f18/out/generated_benchmarks.rs-31%
990.1 µs1,427.6 µs
bench_incremental_no_change
crates/baml_tests/benches/compiler_benchmark.rs-30%
115.3 µs164.7 µs
bench_incremental_add_user_field
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-40d16841fce86f18/out/generated_benchmarks.rs-29%
1.1 ms1.5 ms
bench_incremental_rename_type
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-40d16841fce86f18/out/generated_benchmarks.rs-26%
1.2 ms1.7 ms
bench_incremental_add_new_file
crates/baml_tests/benches/compiler_benchmark.rs-24%
164.6 µs217.3 µs
bench_scale_deep_nesting
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-40d16841fce86f18/out/generated_benchmarks.rs-23%
1.5 ms1.9 ms
bench_incremental_modify_function
crates/baml_tests/benches/compiler_benchmark.rs-22%
171.8 µs220.7 µs
bench_incremental_add_field
crates/baml_tests/benches/compiler_benchmark.rs-22%
172.2 µs220.2 µs
bench_scale_100_functions
/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-40d16841fce86f18/out/generated_benchmarks.rs-18%
2 ms2.4 ms
bench_parse_only_simple
crates/baml_tests/benches/compiler_benchmark.rs0%
102.6 µs102.7 µs
bench_lexer_only_simple
crates/baml_tests/benches/compiler_benchmark.rs-1%
72.1 µs73 µs
The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks
Learn more about archiving benchmarks
bench_incremental_add_user_field
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_incremental_add_attribute
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_scale_100_functions
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.4 ms*
bench_incremental_rename_type
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_incremental_add_string_char
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_scale_deep_nesting
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.4 ms*
bench_incremental_close_string
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rsSkipped
3.3 ms*
bench_incremental_add_string_char
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rsSkipped
4 ms*
bench_scale_100_functions
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rsSkipped
4.1 ms*
bench_scale_deep_nesting
/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rsSkipped
4.1 ms*
Commits
Click on a commit to change the comparison rangeBase
canary
f32fa20
-30%
Implement BEP-009 streaming primitives (Phases 1-8)
7fcd5f3
17 days ago
by antoniosarosi+0.38%
Refactor llm.baml: replace match-on-nullable with null guard + early return
c2daed0
17 days ago
by antoniosarosi-1.65%
Address CodeRabbit review feedback and introduce PerCallContext
170f4cb
17 days ago
by antoniosarosi+5.69%
Address PR review: fix panics, zombie tasks, token tracking, and lock poisoning
fbffefd
17 days ago
by antoniosarosi-6.12%
Add streaming tests and fix stream_primitive to use partial_parse for final value
a997436
17 days ago
by antoniosarosi+0.84%
Add streaming error recovery, metadata accessors, and final_parse sys op
24f1eac
17 days ago
by antoniosarosi-1.42%
Fix BEP-009 streaming regressions
56fc3d5
17 days ago
by antoniosarosi+0.44%
Fix builtin throw-analysis diagnostics
479d3aa
17 days ago
by antoniosarosi+0.44%
Strengthen streaming regression tests
6c7486a
17 days ago
by antoniosarosi-0.09%
Refresh snapshots after canary merge
6531549
17 days ago
by antoniosarosi-1.64%
Address CodeRabbit follow-up comments
34ca454
17 days ago
by antoniosarosi