feat(local-llm): add opt-in Vulkan GGUF support
#408Comparing
issue-122
(fcf8037
) withmain
(5ce59d2
)+44%
- Improvement
- 1
- Untouched
- 38
- Skipped
- 5
Benchmarks
44 total
env_substitution
crates/benchmarks/benches/boot.rs+44%
14.5 µs10.1 µs
namespaced_model_id
crates/benchmarks/benches/boot.rs+1%
2.6 µs2.5 µs
config_validate_toml
crates/benchmarks/benches/boot.rs0%
2.1 ms2.1 ms
config_default_construction
crates/benchmarks/benches/boot.rs0%
32.4 µs32.3 µs
sanitize_tool_result[100000]
crates/benchmarks/benches/boot.rs0%
1.5 ms1.5 ms
values_to_chat_messages[50]
crates/benchmarks/benches/boot.rs0%
62.1 µs62.1 µs
values_to_chat_messages[500]
crates/benchmarks/benches/boot.rs0%
503.1 µs503 µs
full_config_boot_path
crates/benchmarks/benches/boot.rs0%
3.6 ms3.6 ms
tool_result_to_content_vision[10000]
crates/benchmarks/benches/boot.rs0%
240.8 µs240.8 µs
tool_result_to_content_vision[100000]
crates/benchmarks/benches/boot.rs0%
2.3 ms2.3 ms
sanitize_tool_result[1000000]
crates/benchmarks/benches/boot.rs0%
15.1 ms15.1 ms
tool_result_to_content_vision[1000000]
crates/benchmarks/benches/boot.rs0%
22.3 ms22.3 ms
context_window_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
context_window_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
context_window_lookup[gpt-4o]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
session_key_to_filename[user@host:session:42]
crates/benchmarks/benches/boot.rs0%
1.5 µs1.5 µs
context_window_lookup[gpt-5]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
vision_support_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
vision_support_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
context_window_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
context_window_lookup[o3]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
vision_support_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
vision_support_lookup[gpt-4o]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
vision_support_lookup[gpt-5]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
context_window_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
Commits
Click on a commit to change the comparison rangeBase
main
5ce59d2
-0.3%
feat(local-llm): add opt-in vulkan gguf support
e290c66
5 days ago
by penso0%
fix(local-llm): remove unused gguf runtime helper
0fea9d4
4 days ago
by penso+44.63%
Merge remote-tracking branch 'origin/main' into issue-122
fcf8037
3 days ago
by penso