fix(text-splitters): add validation to prevent infinite loop and prevent empty token splitter
#32205Comparing
with1015:chore/text-splitter-validation
(50cdebc
) withmaster
(8b663ed
)0%
- Improvements
- 0
- Regressions
- 0
- Untouched
- 13
- New
- 0
- Dropped
- 0
- Ignored
- 0
Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.Benchmarks
Passed
test_import_time[HumanMessage]
libs/core/tests/benchmarks/test_imports.py::test_import_time[HumanMessage]+1%
210.7 ms
207.8 ms
test_import_time[RunnableLambda]
libs/core/tests/benchmarks/test_imports.py::test_import_time[RunnableLambda]+1%
230.7 ms
227.9 ms
test_import_time[Document]
libs/core/tests/benchmarks/test_imports.py::test_import_time[Document]+1%
207.9 ms
206 ms
test_import_time[InMemoryRateLimiter]
libs/core/tests/benchmarks/test_imports.py::test_import_time[InMemoryRateLimiter]+1%
164.1 ms
163 ms
test_import_time[PydanticOutputParser]
libs/core/tests/benchmarks/test_imports.py::test_import_time[PydanticOutputParser]0%
364.3 ms
362.9 ms
test_import_time[InMemoryVectorStore]
libs/core/tests/benchmarks/test_imports.py::test_import_time[InMemoryVectorStore]0%
239.9 ms
239.4 ms
test_import_time[CallbackManager]
libs/core/tests/benchmarks/test_imports.py::test_import_time[CallbackManager]0%
420.4 ms
420.1 ms
test_import_time[ChatPromptTemplate]
libs/core/tests/benchmarks/test_imports.py::test_import_time[ChatPromptTemplate]0%
413.5 ms
413.2 ms
test_import_time[tool]
libs/core/tests/benchmarks/test_imports.py::test_import_time[tool]0%
466.4 ms
466.6 ms
test_import_time[BaseChatModel]
libs/core/tests/benchmarks/test_imports.py::test_import_time[BaseChatModel]0%
486.1 ms
488 ms
test_import_time[LangChainTracer]
libs/core/tests/benchmarks/test_imports.py::test_import_time[LangChainTracer]-1%
408.2 ms
410.7 ms
test_import_time[Runnable]
libs/core/tests/benchmarks/test_imports.py::test_import_time[Runnable]-1%
228.6 ms
231.2 ms
test_async_callbacks_in_sync
libs/core/tests/benchmarks/test_async_callbacks.py::test_async_callbacks_in_sync-2%
23.6 ms
24 ms
Commits
Click on a commit to change the comparison rangeBase
master
8b663ed
-1%
chore: add validation to prevent infinite loop and prevent empty token splitter
531d6b5
25 days ago
by with10150%
chore: add unit test when decode returns empty string chunks
283a729
17 days ago
by with10150%
chore: remove debugging out log
412dc32
17 days ago
by with1015+1%
Merge branch 'master' into chore/text-splitter-validation
3c173bf
17 days ago
by with10150%
chore: add annotated type for list in unit test
8590a7c
17 days ago
by with1015+2%
Merge branch 'master' into chore/text-splitter-validation
e0a6dd7
6 days ago
by mdrxy-1%
Merge branch 'master' into chore/text-splitter-validation
50cdebc
6 days ago
by mdrxy