Comparing
boundless-lyric
(1da9c19
) withmain
(41a2164
)-12%
- Regression
- 1
- Untouched
- 38
- Skipped
- 5
Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
44 total
env_substitution
crates/benchmarks/benches/boot.rs-12%
11.3 µs12.8 µs
context_window_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs+2%
2.6 µs2.5 µs
context_window_lookup[o3]
crates/benchmarks/benches/boot.rs+1%
2.4 µs2.4 µs
vision_support_lookup[o3]
crates/benchmarks/benches/boot.rs+1%
2.4 µs2.4 µs
context_window_lookup[gpt-5]
crates/benchmarks/benches/boot.rs+1%
2.5 µs2.4 µs
context_window_lookup[gpt-4o]
crates/benchmarks/benches/boot.rs+1%
2.5 µs2.5 µs
context_window_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs+1%
2.5 µs2.5 µs
context_window_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs+1%
2.6 µs2.6 µs
context_window_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs+1%
2.6 µs2.6 µs
values_to_chat_messages[50]
crates/benchmarks/benches/boot.rs0%
66.3 µs66.1 µs
values_to_chat_messages[500]
crates/benchmarks/benches/boot.rs0%
539.5 µs538.3 µs
values_to_chat_messages[2000]
crates/benchmarks/benches/boot.rs0%
2.1 ms2.1 ms
config_default_construction
crates/benchmarks/benches/boot.rs0%
57.4 µs57.3 µs
config_load_toml
crates/benchmarks/benches/boot.rs0%
1.4 ms1.4 ms
vision_support_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
vision_support_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
vision_support_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
context_window_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs0%
2.7 µs2.7 µs
context_window_lookup[mistral-large-latest]
crates/benchmarks/benches/boot.rs0%
2.7 µs2.7 µs
vision_support_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
sanitize_tool_result[1000000]
crates/benchmarks/benches/boot.rs0%
15.1 ms15.1 ms
tool_result_to_content_vision[1000000]
crates/benchmarks/benches/boot.rs0%
22.3 ms22.3 ms
sanitize_tool_result[100000]
crates/benchmarks/benches/boot.rs0%
1.5 ms1.5 ms
tool_result_to_content_vision[100000]
crates/benchmarks/benches/boot.rs0%
2.2 ms2.2 ms
tool_result_to_content_vision[10000]
crates/benchmarks/benches/boot.rs0%
240.6 µs240.7 µs
Commits
Click on a commit to change the comparison rangeBase
main
41a2164
-0.14%
refactor(config): unify provider name validation into single source of truth
d8ab522
2 hours ago
by penso-11.86%
fix(config): address PR review — clarify alias docs, document test limitation
1da9c19
2 hours ago
by penso