GitHub Actions run
CPU Simulation
1 month ago 960aad4 dkindlund:fix/count-tokens-version-suffix pull_requestThis run is associated to a commit that was force-pushed
It will not be associated with its branch history. Be careful when comparing its performance to other runs.Compare
Base
Search a run
Head
Comparefix(vertex): strip version suffix from model name in count_tokens requests
#25800
dkindlund:fix/count-tokens-version-suffix
1 month ago
CPU Simulation
16 total
test_cost_per_token_openai
tests/benchmarks/test_benchmarks.py541.5 µs
test_token_counter_with_tools
tests/benchmarks/test_benchmarks.py413.4 µs
test_get_llm_provider_azure
tests/benchmarks/test_benchmarks.py144.1 µs
test_token_counter_raw_text
tests/benchmarks/test_benchmarks.py182.9 µs
test_token_counter_simple_message
tests/benchmarks/test_benchmarks.py236 µs
test_cost_per_token_anthropic
tests/benchmarks/test_benchmarks.py541.9 µs
test_token_counter_multi_turn
tests/benchmarks/test_benchmarks.py568.6 µs
test_get_model_cost_key_case_insensitive
tests/benchmarks/test_benchmarks.py81.8 µs
test_token_counter_long_content
tests/benchmarks/test_benchmarks.py1.7 ms
test_get_model_info_openai
tests/benchmarks/test_benchmarks.py82.4 µs
test_get_model_info_with_provider
tests/benchmarks/test_benchmarks.py79.9 µs
test_get_llm_provider_with_prefix
tests/benchmarks/test_benchmarks.py136.6 µs
test_get_llm_provider_openai
tests/benchmarks/test_benchmarks.py138.2 µs
test_get_llm_provider_anthropic
tests/benchmarks/test_benchmarks.py141.5 µs
test_get_model_cost_key_exact_match
tests/benchmarks/test_benchmarks.py79.4 µs
test_get_model_info_anthropic
tests/benchmarks/test_benchmarks.py80.8 µs