Comparing
glimmer-variraptor
(b47776a
) withmain
(919c443
)0%
- Untouched
- 39
- Skipped
- 5
No successful run was found on main ( b47776a) during the generation of this report, so 919c443 was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
44 total
namespaced_model_id
crates/benchmarks/benches/boot.rs+1%
2.6 µs2.5 µs
values_to_chat_messages[2000]
crates/benchmarks/benches/boot.rs0%
2 ms2 ms
tool_result_to_content_vision[10000]
crates/benchmarks/benches/boot.rs0%
240.8 µs240.8 µs
config_load_toml
crates/benchmarks/benches/boot.rs0%
1.6 ms1.6 ms
tool_result_to_content_vision[100000]
crates/benchmarks/benches/boot.rs0%
2.3 ms2.3 ms
sanitize_tool_result[1000000]
crates/benchmarks/benches/boot.rs0%
15.1 ms15.1 ms
vision_support_lookup[gpt-5]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
vision_support_lookup[mistral-large-latest]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
vision_support_lookup[gpt-4o]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
vision_support_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
vision_support_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
context_window_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
context_window_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
vision_support_lookup[o3]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
vision_support_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
context_window_lookup[gpt-4o]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
context_window_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
tool_result_to_content_vision[1000000]
crates/benchmarks/benches/boot.rs0%
22.3 ms22.3 ms
vision_support_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
context_window_lookup[gpt-5]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
context_window_lookup[mistral-large-latest]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
context_window_lookup[o3]
crates/benchmarks/benches/boot.rs0%
2.3 µs2.3 µs
vision_support_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
context_window_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
context_window_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs0%
2.7 µs2.7 µs
Commits
Click on a commit to change the comparison rangeBase
main
919c443
-48.2%
feat(providers): add MiniMax M2.7 and missing M2.1 highspeed models
3886e97
1 month ago
by penso+47.7%
fix(providers): update stale MiniMax context-window comment to include M2.7
b47776a
1 month ago
by penso