Comparing
meowing-musician
(b77d8ce
) withmain
(d5623f3
)0%
- Untouched
- 39
- Skipped
- 5
No successful run was found on main ( 3818426) during the generation of this report, so d5623f3 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
44 total
namespaced_model_id
crates/benchmarks/benches/boot.rs+1%
2.6 µs2.5 µs
full_config_boot_path
crates/benchmarks/benches/boot.rs0%
3.7 ms3.6 ms
sanitize_tool_result[10000]
crates/benchmarks/benches/boot.rs0%
159.1 µs158.8 µs
tool_result_to_content_vision[10000]
crates/benchmarks/benches/boot.rs0%
240.7 µs240.7 µs
tool_result_to_content_vision[100000]
crates/benchmarks/benches/boot.rs0%
2.2 ms2.2 ms
vision_support_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
vision_support_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
vision_support_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
vision_support_lookup[gpt-4o]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
context_window_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
vision_support_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
session_key_to_filename[2026-02-09T12:00:00Z]
crates/benchmarks/benches/boot.rs0%
803.3 ns803.3 ns
vision_support_lookup[mistral-large-latest]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
context_window_lookup[gpt-5]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
context_window_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
tool_result_to_content_vision[1000000]
crates/benchmarks/benches/boot.rs0%
22.3 ms22.3 ms
context_window_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
context_window_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
vision_support_lookup[gpt-5]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
context_window_lookup[o3]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
context_window_lookup[mistral-large-latest]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
context_window_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs0%
2.7 µs2.7 µs
vision_support_lookup[o3]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
context_window_lookup[gpt-4o]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
vision_support_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
Commits
Click on a commit to change the comparison rangeBase
main
d5623f3
-11.87%
feat(providers): add zai-code provider for Z.AI Coding plan
bdf54d2
2 days ago
by penso+11.59%
fix(providers): address PR review comments for zai-code
b77d8ce
2 days ago
by penso