Comparing
nervous-ironclad
(4dcaaf5
) withmain
(50f621b
)-46%
- Regression
- 1
- Untouched
- 38
- Skipped
- 5
Benchmarks
44 total
env_substitution
crates/benchmarks/benches/boot.rs-46%
10 µs18.7 µs
session_key_to_filename[2026-02-09T12:00:00Z]
crates/benchmarks/benches/boot.rs-7%
745 ns803.3 ns
session_key_to_filename[default]
crates/benchmarks/benches/boot.rs-4%
653.3 ns682.5 ns
session_key_to_filename[user@host:session:42]
crates/benchmarks/benches/boot.rs-2%
1.5 µs1.5 µs
namespaced_model_id
crates/benchmarks/benches/boot.rs+1%
2.5 µs2.5 µs
config_load_toml
crates/benchmarks/benches/boot.rs-1%
1.8 ms1.8 ms
full_config_boot_path
crates/benchmarks/benches/boot.rs0%
4 ms4 ms
config_validate_toml
crates/benchmarks/benches/boot.rs0%
2.3 ms2.3 ms
sanitize_tool_result[10000]
crates/benchmarks/benches/boot.rs0%
158.9 µs159.2 µs
values_to_chat_messages[50]
crates/benchmarks/benches/boot.rs0%
62 µs62 µs
config_default_construction
crates/benchmarks/benches/boot.rs0%
33.1 µs33.1 µs
values_to_chat_messages[500]
crates/benchmarks/benches/boot.rs0%
504.1 µs503.9 µs
config_template_generation
crates/benchmarks/benches/boot.rs0%
97.4 µs97.4 µs
config_serde_roundtrip
crates/benchmarks/benches/boot.rs0%
1.6 ms1.6 ms
values_to_chat_messages[2000]
crates/benchmarks/benches/boot.rs0%
2 ms2 ms
tool_result_to_content_vision[10000]
crates/benchmarks/benches/boot.rs0%
240.9 µs240.9 µs
sanitize_tool_result[100000]
crates/benchmarks/benches/boot.rs0%
1.5 ms1.5 ms
sanitize_tool_result[1000000]
crates/benchmarks/benches/boot.rs0%
15.1 ms15.1 ms
tool_result_to_content_vision[100000]
crates/benchmarks/benches/boot.rs0%
2.3 ms2.3 ms
vision_support_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
context_window_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
vision_support_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs0%
2.7 µs2.7 µs
context_window_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
vision_support_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
tool_result_to_content_vision[1000000]
crates/benchmarks/benches/boot.rs0%
22.3 ms22.3 ms
Commits
Click on a commit to change the comparison rangeBase
main
50f621b
-0.36%
fix(providers): deliver MiniMax system prompt via first user message
64a0a4f
5 months ago
by penso+0.07%
test(providers): add Moonshot (Kimi) live API integration tests
4fe1eff
5 months ago
by penso-0.05%
test(providers): add OpenAI and Anthropic live API integration tests
f6c8569
5 months ago
by penso-0.04%
fix(tests): use streaming probe for OpenAI integration tests
0a29fa0
5 months ago
by penso-45.93%
fix(providers): bump GPT-5 probe output cap to 16 tokens
4dcaaf5
5 months ago
by penso