Avatar for the Aureliolo user
Aureliolo
synthorg
BlogDocsChangelog

feat: deterministic recorded-LLM cassette replay at the provider chokepoint

#2010Merged
Comparing
test/llm-cassette-replay
(
a80ce97
) with
main
(
03d2587
)
CodSpeed Performance Gauge
0%
Untouched
33
Skipped
21

Benchmarks

54 total
test_scrub_small_clean
tests/benchmarks/test_observability_scrubber.py
CodSpeed Performance Gauge
+4%
99.8 µs96.4 µs
test_normalize_utc
tests/benchmarks/test_persistence_datetime.py
CodSpeed Performance Gauge
+2%
12.5 µs12.3 µs
test_scrub_medium_mixed
tests/benchmarks/test_observability_scrubber.py
CodSpeed Performance Gauge
+1%
286.3 µs283.4 µs
test_format_iso_utc_single
tests/benchmarks/test_persistence_datetime.py
CodSpeed Performance Gauge
+1%
31.1 µs30.9 µs
test_compute_message_overhead
tests/benchmarks/test_coordination_metrics.py
CodSpeed Performance Gauge
+1%
35.7 µs35.5 µs
test_sum_tokens_2000
tests/benchmarks/test_budget_aggregation.py
CodSpeed Performance Gauge
+1%
1.6 ms1.6 ms
test_parse_iso_utc_single
tests/benchmarks/test_persistence_datetime.py
CodSpeed Performance Gauge
+1%
17 µs16.9 µs
test_compute_amdahl_ceiling
tests/benchmarks/test_coordination_metrics.py
CodSpeed Performance Gauge
+1%
31.2 µs31.1 µs
test_scrub_adversarial
tests/benchmarks/test_observability_scrubber.py
CodSpeed Performance Gauge
0%
846.2 µs842.4 µs
test_coerce_row_timestamp_string
tests/benchmarks/test_persistence_datetime.py
CodSpeed Performance Gauge
0%
21 µs20.9 µs
test_coerce_row_timestamp_datetime
tests/benchmarks/test_persistence_datetime.py
CodSpeed Performance Gauge
0%
24.4 µs24.3 µs
test_compute_token_speedup_ratio
tests/benchmarks/test_coordination_metrics.py
CodSpeed Performance Gauge
0%
39.1 µs39 µs
test_bigram_jaccard_short
tests/benchmarks/test_memory_ranking.py
CodSpeed Performance Gauge
0%
62.9 µs62.7 µs
test_agent_task_scorer_single
tests/benchmarks/test_routing_scorer.py
CodSpeed Performance Gauge
0%
310.7 µs309.7 µs
test_fuse_ranked_lists_5x200
tests/benchmarks/test_memory_ranking.py
CodSpeed Performance Gauge
0%
13.1 ms13 ms
test_compute_efficiency
tests/benchmarks/test_coordination_metrics.py
CodSpeed Performance Gauge
0%
35.2 µs35.1 µs
test_fuse_ranked_lists_3x100
tests/benchmarks/test_memory_ranking.py
CodSpeed Performance Gauge
0%
1.8 ms1.8 ms
test_classify_severity
tests/benchmarks/test_budget_optimizer.py
CodSpeed Performance Gauge
0%
15 µs15 µs
test_rate_efficiency
tests/benchmarks/test_budget_optimizer.py
CodSpeed Performance Gauge
0%
16.5 µs16.5 µs
test_compute_cost_per_1k
tests/benchmarks/test_budget_aggregation.py
CodSpeed Performance Gauge
0%
19.2 µs19.2 µs
test_bigram_jaccard_long
tests/benchmarks/test_memory_ranking.py
CodSpeed Performance Gauge
0%
238.3 µs238 µs
test_compute_window_costs_12
tests/benchmarks/test_budget_optimizer.py
CodSpeed Performance Gauge
0%
349.9 µs349.4 µs
test_rank_memories_100
tests/benchmarks/test_memory_ranking.py
CodSpeed Performance Gauge
0%
1.8 ms1.8 ms
test_rank_memories_with_shared
tests/benchmarks/test_memory_ranking.py
CodSpeed Performance Gauge
0%
2.6 ms2.6 ms
test_compute_redundancy_rate_100
tests/benchmarks/test_coordination_metrics.py
CodSpeed Performance Gauge
0%
293.7 µs293.4 µs

Commits

Click on a commit to change the comparison range
Base
main
03d2587
+0.42%
fix: address pre-PR review findings (cassette logging, SEC-1, ReDoS, async persist)
10df914
18 hours ago
by Aureliolo
-0.06%
fix: babysit round 1, 11 findings (8 coderabbit, 3 gemini)
3eb9ea9
17 hours ago
by Aureliolo
-0.02%
fix: babysit round 2, 1 finding (1 coderabbit)
0c72c7e
17 hours ago
by Aureliolo
-0.04%
fix: babysit round 3, 1 finding (1 coderabbit)
a80ce97
17 hours ago
by Aureliolo
© 2026 CodSpeed Technology
Home Terms Privacy Docs