Comparing
fix/test-isolation-hunt
(c631d0a
) withmain
(355a9ff
)+13%
- Improvement
- 1
- Untouched
- 32
- Skipped
- 21
No successful run was found on main ( 8cbf83a) during the generation of this report, so 355a9ff was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
54 total
test_scrub_small_clean
tests/benchmarks/test_observability_scrubber.py+13%
110.7 µs98.3 µs
test_agent_task_scorer_batch_10
tests/benchmarks/test_routing_scorer.py+1%
1.4 ms1.4 ms
test_compute_cost_per_1k
tests/benchmarks/test_budget_aggregation.py0%
22.8 µs22.7 µs
test_group_by_agent_500
tests/benchmarks/test_budget_aggregation.py0%
301.9 µs301.5 µs
test_bigram_jaccard_long
tests/benchmarks/test_memory_ranking.py0%
242.9 µs242.5 µs
test_diversity_penalty_50
tests/benchmarks/test_memory_ranking.py0%
16.6 ms16.6 ms
test_coerce_row_timestamp_datetime
tests/benchmarks/test_persistence_datetime.py0%
28 µs28 µs
test_compute_window_costs_12
tests/benchmarks/test_budget_optimizer.py0%
327.8 µs327.5 µs
test_scrub_medium_mixed
tests/benchmarks/test_observability_scrubber.py0%
286.7 µs286.5 µs
test_sum_cost_2000
tests/benchmarks/test_budget_aggregation.py0%
1.1 ms1.1 ms
test_rank_memories_1000
tests/benchmarks/test_memory_ranking.py0%
14.9 ms14.9 ms
test_scrub_adversarial
tests/benchmarks/test_observability_scrubber.py0%
897.9 µs898 µs
test_format_iso_utc_batch_96
tests/benchmarks/test_persistence_datetime.py0%
461.7 µs461.8 µs
test_parse_iso_utc_batch_96
tests/benchmarks/test_persistence_datetime.py0%
152.7 µs152.7 µs
test_compute_redundancy_rate_100
tests/benchmarks/test_coordination_metrics.py0%
294.3 µs294.4 µs
test_parse_iso_utc_single
tests/benchmarks/test_persistence_datetime.py0%
20.7 µs20.8 µs
test_fuse_ranked_lists_3x100
tests/benchmarks/test_memory_ranking.py0%
1.7 ms1.7 ms
test_format_iso_utc_single
tests/benchmarks/test_persistence_datetime.py0%
34.6 µs34.7 µs
test_fuse_ranked_lists_5x200
tests/benchmarks/test_memory_ranking.py0%
11.9 ms11.9 ms
test_compute_message_overhead
tests/benchmarks/test_coordination_metrics.py0%
38.9 µs39.1 µs
test_bigram_jaccard_short
tests/benchmarks/test_memory_ranking.py0%
65.7 µs66 µs
test_compute_token_speedup_ratio
tests/benchmarks/test_coordination_metrics.py0%
43.1 µs43.3 µs
test_compute_straggler_gap_20_agents
tests/benchmarks/test_coordination_metrics.py0%
152 µs152.7 µs
test_sum_tokens_2000
tests/benchmarks/test_budget_aggregation.py-1%
1.6 ms1.6 ms
Commits
Click on a commit to change the comparison rangeBase
main
355a9ff
+12.62%
fix(test): babysit round 1, 9 findings (8 coderabbit, 1 gemini)
c631d0a
23 days ago
by Aureliolo