Comparing
organic-cashew
(28a980a
) withmain
(97769ad
)-11%
- Regression
- 1
- Untouched
- 38
- Skipped
- 5
Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
44 total
env_substitution
crates/benchmarks/benches/boot.rs-11%
12.8 µs14.3 µs
session_key_to_filename[project:backend:debug-auth]
crates/benchmarks/benches/boot.rs+8%
801.9 ns743.6 ns
session_key_to_filename[default]
crates/benchmarks/benches/boot.rs+5%
653.3 ns624.2 ns
namespaced_model_id
crates/benchmarks/benches/boot.rs+4%
2.7 µs2.5 µs
session_key_to_filename[2026-02-09T12:00:00Z]
crates/benchmarks/benches/boot.rs+4%
803.3 ns774.2 ns
session_key_to_filename[user@host:session:42]
crates/benchmarks/benches/boot.rs+2%
1.5 µs1.5 µs
config_default_construction
crates/benchmarks/benches/boot.rs+1%
59.5 µs59.1 µs
values_to_chat_messages[2000]
crates/benchmarks/benches/boot.rs0%
2.2 ms2.2 ms
tool_result_to_content_vision[10000]
crates/benchmarks/benches/boot.rs0%
240.9 µs240.8 µs
tool_result_to_content_vision[1000000]
crates/benchmarks/benches/boot.rs0%
22.3 ms22.3 ms
sanitize_tool_result[1000000]
crates/benchmarks/benches/boot.rs0%
15.1 ms15.1 ms
tool_result_to_content_vision[100000]
crates/benchmarks/benches/boot.rs0%
2.2 ms2.2 ms
sanitize_tool_result[100000]
crates/benchmarks/benches/boot.rs0%
1.5 ms1.5 ms
config_validate_toml
crates/benchmarks/benches/boot.rs0%
972.2 µs972.6 µs
sanitize_tool_result[10000]
crates/benchmarks/benches/boot.rs0%
158.9 µs159 µs
values_to_chat_messages[500]
crates/benchmarks/benches/boot.rs0%
566.4 µs567.1 µs
full_config_boot_path
crates/benchmarks/benches/boot.rs0%
2.3 ms2.4 ms
config_template_generation
crates/benchmarks/benches/boot.rs0%
87.1 µs87.3 µs
config_load_toml
crates/benchmarks/benches/boot.rs0%
1.5 ms1.5 ms
config_serde_roundtrip
crates/benchmarks/benches/boot.rs0%
2.9 ms2.9 ms
values_to_chat_messages[50]
crates/benchmarks/benches/boot.rs0%
70.1 µs70.4 µs
vision_support_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs-1%
2.6 µs2.6 µs
vision_support_lookup[gpt-4o]
crates/benchmarks/benches/boot.rs-1%
2.4 µs2.5 µs
vision_support_lookup[gpt-5]
crates/benchmarks/benches/boot.rs-1%
2.4 µs2.4 µs
vision_support_lookup[mistral-large-latest]
crates/benchmarks/benches/boot.rs-2%
2.6 µs2.6 µs
Commits
Click on a commit to change the comparison rangeBase
main
97769ad
+18.89%
feat(tls): support public IP SAN for generated certs
9a4e665
2 days ago
by penso-29.43%
fix(tls): warn on unusable public IP config
28a980a
2 days ago
by penso