Comparing
mdrxy/openai-rfc-1-0
(f36e014
) withcc/1.0/standard_content
(d111965
)-29%
- Improvements
- 0
- Regressions
- 1
- Untouched
- 12
- New
- 0
- Dropped
- 0
- Ignored
- 0
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.No successful run was found on cc/1.0/standard_content ( 313ed7b) during the generation of this report, so 823c15c was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.
Benchmarks
Failed
test_import_time[HumanMessage]Regression
libs/core/tests/benchmarks/test_imports.py::test_import_time[HumanMessage]-29%
211.8 ms
298.6 ms
Passed
test_import_time[ChatPromptTemplate]
libs/core/tests/benchmarks/test_imports.py::test_import_time[ChatPromptTemplate]+1%
411.5 ms
408.9 ms
test_async_callbacks_in_sync
libs/core/tests/benchmarks/test_async_callbacks.py::test_async_callbacks_in_sync-1%
23.7 ms
24.1 ms
test_import_time[Document]
libs/core/tests/benchmarks/test_imports.py::test_import_time[Document]-2%
213.9 ms
217.7 ms
test_import_time[RunnableLambda]
libs/core/tests/benchmarks/test_imports.py::test_import_time[RunnableLambda]-2%
237.4 ms
241.9 ms
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.py::test_import_time[PydanticOutputParser]-2%
363.1 ms
371.5 ms
test_import_time[InMemoryRateLimiter]
libs/core/tests/benchmarks/test_imports.py::test_import_time[InMemoryRateLimiter]-4%
163.5 ms
170.1 ms
test_import_time[Runnable]
libs/core/tests/benchmarks/test_imports.py::test_import_time[Runnable]-4%
229.4 ms
239.8 ms
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.py::test_import_time[InMemoryVectorStore]-4%
245.5 ms
256.8 ms
test_import_time[tool]
libs/core/tests/benchmarks/test_imports.py::test_import_time[tool]-5%
466 ms
491.7 ms
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.py::test_import_time[LangChainTracer]-6%
411.4 ms
436 ms
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.py::test_import_time[CallbackManager]-6%
417.7 ms
444.8 ms
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.py::test_import_time[BaseChatModel]-6%
485.9 ms
517.6 ms
Commits
Click on a commit to change the comparison rangeBase
cc/1.0/standard_content
d111965
-27%
test(openai): address some type issues in tests
4a26b37
8 days ago
by mdrxy-2%
Merge branch 'cc/1.0/standard_content' into mdrxy/openai-rfc-1-0
f36e014
8 days ago
by mdrxy