[codex] add Langfuse tracing and chat debug correlation
#535Comparing
pickle-receipt
(147d22a
) withmain
(3272781
)+80%
- Improvement
- 1
- Untouched
- 38
- Skipped
- 5
Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments, which may affect the accuracy of the results. Learn more about regression causes.Benchmarks
44 total
env_substitution
crates/benchmarks/benches/boot.rs+80%
18.2 µs10.1 µs
session_key_to_filename[2026-02-09T12:00:00Z]
crates/benchmarks/benches/boot.rs-7%
745 ns803.3 ns
context_window_lookup[gpt-4o]
crates/benchmarks/benches/boot.rs+5%
2.5 µs2.4 µs
session_key_to_filename[default]
crates/benchmarks/benches/boot.rs-4%
653.3 ns682.5 ns
context_window_lookup[o3]
crates/benchmarks/benches/boot.rs+4%
2.4 µs2.3 µs
context_window_lookup[gpt-5]
crates/benchmarks/benches/boot.rs+4%
2.5 µs2.4 µs
session_key_to_filename[project:backend:debug-auth]
crates/benchmarks/benches/boot.rs-4%
772.8 ns801.9 ns
context_window_lookup[mistral-large-latest]
crates/benchmarks/benches/boot.rs+3%
2.6 µs2.6 µs
context_window_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs+3%
2.6 µs2.6 µs
context_window_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs+2%
2.6 µs2.5 µs
context_window_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs+2%
2.6 µs2.6 µs
context_window_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs+2%
2.7 µs2.7 µs
config_template_generation
crates/benchmarks/benches/boot.rs-2%
84.3 µs85.9 µs
config_validate_toml
crates/benchmarks/benches/boot.rs-2%
2.1 ms2.2 ms
full_config_boot_path
crates/benchmarks/benches/boot.rs-1%
3.7 ms3.7 ms
context_window_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs+1%
2.5 µs2.5 µs
vision_support_lookup[claude-sonnet-4-5-20250929]
crates/benchmarks/benches/boot.rs-1%
2.6 µs2.6 µs
vision_support_lookup[kimi-k2.5]
crates/benchmarks/benches/boot.rs-1%
2.5 µs2.5 µs
namespaced_model_id
crates/benchmarks/benches/boot.rs-1%
2.5 µs2.5 µs
vision_support_lookup[gemini-2.0-flash]
crates/benchmarks/benches/boot.rs-1%
2.5 µs2.6 µs
vision_support_lookup[codestral-latest]
crates/benchmarks/benches/boot.rs-1%
2.5 µs2.6 µs
vision_support_lookup[mistral-large-latest]
crates/benchmarks/benches/boot.rs-1%
2.6 µs2.6 µs
vision_support_lookup[unknown-model-xyz]
crates/benchmarks/benches/boot.rs-1%
2.6 µs2.6 µs
config_serde_roundtrip
crates/benchmarks/benches/boot.rs-1%
1.5 ms1.5 ms
config_load_toml
crates/benchmarks/benches/boot.rs-1%
1.7 ms1.7 ms
Commits
Click on a commit to change the comparison rangeBase
main
3272781
+79.59%
feat(observability): add langfuse tracing
147d22a
4 months ago
by penso