feat/render-prompt-orchestrator - Branch - BoundaryML/baml

Baml builtins compiler infra + `render_prompt` proof of concept

#3050

Comparing

feat/render-prompt-orchestrator

(

3dd47bc

) with

canary

(

1191a7c

)

-44%

Regression: 3

Untouched: 12

Skipped: 49

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Benchmarks

64 total

bench_incremental_no_change

crates/baml_tests/benches/compiler_benchmark.rs

-44%

10.3 µs18.3 µs

bench_incremental_modify_function

crates/baml_tests/benches/compiler_benchmark.rs

-22%

45 µs57.4 µs

bench_incremental_rename_type

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs

-12%

228.4 µs259.3 µs

bench_incremental_add_new_file

crates/baml_tests/benches/compiler_benchmark.rs

+2%

45.2 µs44.4 µs

bench_scale_deep_nesting

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs

+1%

437.6 µs431.3 µs

bench_lexer_only_simple

crates/baml_tests/benches/compiler_benchmark.rs

35.1 µs35 µs

bench_scale_100_functions

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs

767.6 µs771 µs

bench_parse_only_simple

crates/baml_tests/benches/compiler_benchmark.rs

-1%

60.4 µs60.9 µs

bench_empty_project

crates/baml_tests/benches/compiler_benchmark.rs

-1%

33.9 µs34.4 µs

bench_incremental_add_field

crates/baml_tests/benches/compiler_benchmark.rs

-2%

46.8 µs47.8 µs

bench_incremental_add_user_field

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs

-3%

133 µs136.5 µs

bench_incremental_add_attribute

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs

-3%

94.8 µs98.2 µs

bench_single_simple_file

crates/baml_tests/benches/compiler_benchmark.rs

-4%

61.5 µs63.9 µs

bench_incremental_add_string_char

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs

-4%

51.8 µs53.9 µs

bench_incremental_close_string

/home/runner/work/baml/baml/baml_language/target/release/build/baml_tests-bcd536c40668a69e/out/generated_benchmarks.rs

-4%

52.3 µs54.5 µs

The benchmarks below were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks

bench_incremental_add_user_field

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.3 ms*

bench_incremental_add_attribute

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.3 ms*

bench_scale_100_functions

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.4 ms*

bench_incremental_rename_type

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.3 ms*

bench_incremental_add_string_char

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.3 ms*

bench_scale_deep_nesting

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.4 ms*

bench_incremental_close_string

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-74008be547e634ff/out/generated_benchmarks.rs

Skipped

3.3 ms*

bench_incremental_add_string_char

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rs

Skipped

4 ms*

bench_scale_100_functions

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rs

Skipped

4.1 ms*

bench_scale_deep_nesting

/actions-runner/_work/baml/baml/baml_language/target/release/build/baml_tests-3a90ee31b6869f31/out/generated_benchmarks.rs

Skipped

4.1 ms*

Commits

Click on a commit to change the comparison range

Base

canary

1191a7c

-0.51%

baml-language: add render_prompt orchestrator infrastructure

dd4fcb7

10 hours ago

by antoniosarosi

-11.48%

Add ClientDefinition type and client resolution SysOps

d3a98a3

8 hours ago

by antoniosarosi

-31.72%

feat(render_prompt): implement end-to-end render_prompt flow

3dd47bc

4 hours ago

by antoniosarosi

Home Terms Privacy Docs