Comparing
thoughtful-pail
(b55f364
) withmain
(f6152aa
)-16%
- Regression
- 1
- Untouched
- 38
- Skipped
- 5
Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
44 total
env_substitution
crates/benchmarks/benches/boot.rs-16%
11.3 µs13.5 µs
context_window_lookup[o3]
crates/benchmarks/benches/boot.rs+1%
2.3 µs2.3 µs
context_window_lookup[gpt-5]
crates/benchmarks/benches/boot.rs+1%
2.4 µs2.4 µs
context_window_lookup[gpt-4o]
crates/benchmarks/benches/boot.rs+1%
2.4 µs2.4 µs
context_window_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs+1%
2.5 µs2.4 µs
context_window_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs+1%
2.5 µs2.5 µs
context_window_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs+1%
2.6 µs2.5 µs
context_window_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs+1%
2.6 µs2.5 µs
context_window_lookup[mistral-large-latest]
crates/benchmarks/benches/boot.rs+1%
2.6 µs2.6 µs
context_window_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs+1%
2.7 µs2.6 µs
config_serde_roundtrip
crates/benchmarks/benches/boot.rs0%
2.7 ms2.7 ms
tool_result_to_content_vision[100000]
crates/benchmarks/benches/boot.rs0%
2.2 ms2.2 ms
sanitize_tool_result[1000000]
crates/benchmarks/benches/boot.rs0%
15.1 ms15.1 ms
tool_result_to_content_vision[1000000]
crates/benchmarks/benches/boot.rs0%
22.3 ms22.3 ms
vision_support_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
vision_support_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
vision_support_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
vision_support_lookup[o3]
crates/benchmarks/benches/boot.rs0%
2.3 µs2.3 µs
vision_support_lookup[gpt-5]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
vision_support_lookup[gpt-4o]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
vision_support_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs0%
2.4 µs2.4 µs
vision_support_lookup[mistral-large-latest]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
vision_support_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs0%
2.5 µs2.5 µs
namespaced_model_id
crates/benchmarks/benches/boot.rs0%
2.6 µs2.6 µs
sanitize_tool_result[10000]
crates/benchmarks/benches/boot.rs0%
159.1 µs159.1 µs
Commits
Click on a commit to change the comparison rangeBase
main
f6152aa
-13.55%
fix: show RPC error messages in skills UI and auto-trust on install
484cd49
1 day ago
by penso+13.42%
test: add E2E tests for skills Install button and error message fix
e6486c4
1 day ago
by penso+0.09%
fix: address PR review comments
4da41e6
1 day ago
by penso-0.5%
feat: add Install All button per repository on skills page
241da78
1 day ago
by penso-10.63%
fix: remove .take(30) cap on skills search results
50c035b
1 day ago
by penso+10.91%
fix: Install All re-fetches state from server after completion
db8a784
1 day ago
by penso+0.29%
debug: add tracing to Install All and toggle_skill
c99cf0f
24 hours ago
by penso-0.08%
debug: add drift detection logging, downgrade skill watcher to debug
1ee9c7f
24 hours ago
by penso+0.06%
debug: log manifest path and repo state in repos_list_full
4d3a211
24 hours ago
by penso-0.19%
debug: verify manifest persists by re-reading after save in toggle_skill
edda5cd
24 hours ago
by penso-18.44%
fix: deduplicate skills by name and skip test fixtures during scan
bab05e0
23 hours ago
by penso+2.4%
feat: add Repositories and ClawHub tabs to onboarding skills step
b55f364
23 hours ago
by penso