GitHub Actions run
Wall TimeCPU Simulation
4 hours ago a8ae3b0 cc/calibrate_token_counts pull_requestUnknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Compare
Base
Search a run
Head
Comparefeat(core): add option to use usage_metadata to scale approximate token counts
#34998
cc/calibrate_token_counts
4 hours ago
Wall TimeCPU Simulation
34 total
test_import_time[ChatPromptTemplate]
libs/core/tests/benchmarks/test_imports.py650.2 ms
test_import_time[RunnableLambda]
libs/core/tests/benchmarks/test_imports.py531.3 ms
test_import_time[tool]
libs/core/tests/benchmarks/test_imports.py541.7 ms
test_import_time[Runnable]
libs/core/tests/benchmarks/test_imports.py523 ms
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.py556.7 ms
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.py459.9 ms
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.py484.9 ms
test_import_time[Document]
libs/core/tests/benchmarks/test_imports.py189.8 ms
test_import_time[HumanMessage]
libs/core/tests/benchmarks/test_imports.py271.7 ms
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.py664.9 ms
test_import_time[InMemoryRateLimiter]
libs/core/tests/benchmarks/test_imports.py178.8 ms
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.py562 ms
test_async_callbacks_in_sync
libs/core/tests/benchmarks/test_async_callbacks.py24.3 ms
The benchmarks below were skipped, so their baseline results are used instead.
test_create_chat_prompt_init_time
libs/partners/prompty/tests/unit_tests/test_standard.pySkipped
311.9 µs*
test_init_time
libs/partners/deepseek/tests/unit_tests/test_chat_models.py::TestChatDeepSeekUnitSkipped
1.6 s*
test_exa_retriever_init_time
libs/partners/exa/tests/unit_tests/test_standard.pySkipped
315.8 µs*
test_init_time
libs/partners/perplexity/tests/unit_tests/test_chat_models_standard.py::TestPerplexityStandardSkipped
1.7 s*
test_init_time
libs/partners/ollama/tests/unit_tests/test_chat_models.py::TestChatOllamaSkipped
1.6 s*
test_qdrant_vectorstore_init_time
libs/partners/qdrant/tests/unit_tests/test_standard.pySkipped
224.7 ms*
test_init_time
libs/partners/xai/tests/unit_tests/test_chat_models_standard.py::TestXAIStandardSkipped
3.3 s*
test_init_time
libs/partners/groq/tests/unit_tests/test_standard.py::TestGroqStandardSkipped
1.6 s*
test_stream_time
libs/partners/anthropic/tests/integration_tests/test_standard.py::TestAnthropicStandardSkipped
31.3 ms*
test_init_time
libs/partners/anthropic/tests/unit_tests/test_standard.py::TestAnthropicStandardSkipped
798.5 µs*
test_init_time_with_client
libs/partners/anthropic/tests/unit_tests/test_standard.pySkipped
2.3 ms*
test_chroma_init_time
libs/partners/chroma/tests/unit_tests/test_standard.pySkipped
60.1 ms*