Comparing
innovative-iguanacolossus
(c7320b7
) withmain
(b1a68d0
)+15%
- Improvement
- 1
- Untouched
- 38
- Skipped
- 5
Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
44 total
env_substitution
crates/benchmarks/benches/boot.rs+15%
11.6 µs10.2 µs
config_serde_roundtrip
crates/benchmarks/benches/boot.rs+1%
1.5 ms1.5 ms
values_to_chat_messages[2000]
crates/benchmarks/benches/boot.rs0%
2 ms2 ms
full_config_boot_path
crates/benchmarks/benches/boot.rs0%
3.7 ms3.6 ms
sanitize_tool_result[10000]
crates/benchmarks/benches/boot.rs0%
158.9 µs158.8 µs
config_validate_toml
crates/benchmarks/benches/boot.rs0%
2.1 ms2.1 ms
tool_result_to_content_vision[10000]
crates/benchmarks/benches/boot.rs0%
240.7 µs240.7 µs
sanitize_tool_result[100000]
crates/benchmarks/benches/boot.rs0%
1.5 ms1.5 ms
tool_result_to_content_vision[100000]
crates/benchmarks/benches/boot.rs0%
2.2 ms2.2 ms
sanitize_tool_result[1000000]
crates/benchmarks/benches/boot.rs0%
15.1 ms15.1 ms
tool_result_to_content_vision[1000000]
crates/benchmarks/benches/boot.rs0%
22.3 ms22.3 ms
values_to_chat_messages[500]
crates/benchmarks/benches/boot.rs0%
505.4 µs505.5 µs
config_template_generation
crates/benchmarks/benches/boot.rs0%
83.4 µs83.5 µs
values_to_chat_messages[50]
crates/benchmarks/benches/boot.rs0%
62.3 µs62.4 µs
config_default_construction
crates/benchmarks/benches/boot.rs0%
32.3 µs32.4 µs
config_load_toml
crates/benchmarks/benches/boot.rs0%
1.7 ms1.7 ms
context_window_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs-1%
2.7 µs2.7 µs
context_window_lookup[mistral-large-latest]
crates/benchmarks/benches/boot.rs-1%
2.6 µs2.6 µs
vision_support_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs-1%
2.6 µs2.6 µs
context_window_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs-1%
2.6 µs2.6 µs
context_window_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs-1%
2.6 µs2.6 µs
vision_support_lookup[mistral-large-latest]
crates/benchmarks/benches/boot.rs-1%
2.6 µs2.6 µs
vision_support_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs-1%
2.6 µs2.6 µs
namespaced_model_id
crates/benchmarks/benches/boot.rs-1%
2.5 µs2.6 µs
context_window_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs-1%
2.5 µs2.6 µs
Commits
Click on a commit to change the comparison rangeBase
main
b1a68d0
-10.97%
fix(vault): allow unencrypted session history while sealed
5f91f57
2 days ago
by penso+25.62%
fix(vault): address PR review comments
c7320b7
2 days ago
by penso