huggingface: batching in huggingface pipeline
#31533Comparing
TheAnkurGoswami:hf-pipeline-batching
(8941172
) withmaster
(ea1345a
)Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.0%
- Improvements
- 0
- Regressions
- 0
- Untouched
- 13
- New
- 0
- Dropped
- 0
- Ignored
- 0
Benchmarks
Passed
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.py::test_import_time[BaseChatModel]+2%
488 ms
479.3 ms
test_import_time[tool]
libs/core/tests/benchmarks/test_imports.py::test_import_time[tool]+2%
467.9 ms
460.7 ms
test_import_time[Runnable]
libs/core/tests/benchmarks/test_imports.py::test_import_time[Runnable]+1%
227.6 ms
225 ms
test_import_time[ChatPromptTemplate]
libs/core/tests/benchmarks/test_imports.py::test_import_time[ChatPromptTemplate]+1%
393.2 ms
388.8 ms
test_import_time[HumanMessage]
libs/core/tests/benchmarks/test_imports.py::test_import_time[HumanMessage]+1%
186.9 ms
185.4 ms
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.py::test_import_time[CallbackManager]+1%
414.8 ms
412.7 ms
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.py::test_import_time[PydanticOutputParser]0%
361.7 ms
360 ms
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.py::test_import_time[InMemoryVectorStore]0%
238.3 ms
237.3 ms
test_import_time[RunnableLambda]
libs/core/tests/benchmarks/test_imports.py::test_import_time[RunnableLambda]0%
226.4 ms
225.6 ms
test_async_callbacks_in_sync
libs/core/tests/benchmarks/test_async_callbacks.py::test_async_callbacks_in_sync0%
22 ms
22 ms
test_import_time[Document]
libs/core/tests/benchmarks/test_imports.py::test_import_time[Document]0%
184.6 ms
184.4 ms
test_import_time[InMemoryRateLimiter]
libs/core/tests/benchmarks/test_imports.py::test_import_time[InMemoryRateLimiter]0%
162.2 ms
162.2 ms
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.py::test_import_time[LangChainTracer]-3%
405.3 ms
418.9 ms
Commits
Click on a commit to change the comparison rangeBase
master
ea1345a
0%
batching for huggingface pipelines
0c8792d
19 days ago
by TheAnkurGoswami-2%
code formatting
96d6483
19 days ago
by TheAnkurGoswami+4%
Merge branch 'master' into hf-pipeline-batching
f8972cd
2 days ago
by TheAnkurGoswami-2%
Merge branch 'master' into hf-pipeline-batching
8941172
23 hours ago
by TheAnkurGoswami