AmazingcatAndrew:feat/capture-raw-provider-response - Branch - langchain-ai/langchain - CodSpeed

Blog Docs Changelog

feat(core): Capture raw provider response

Comparing

AmazingcatAndrew:feat/capture-raw-provider-response

(

40d9386

) with

master

(

52b1516

)

+31%

Improvements: 9

Untouched: 10

Skipped: 15

Unknown Walltime execution environment detected

Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data. For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.

Benchmarks

Skipped (15)

Improved

test_async_callbacks_in_sync

libs/core/tests/benchmarks/test_async_callbacks.py

+31%

24.3 ms*18.5 ms

test_import_time[PydanticOutputParser]

libs/core/tests/benchmarks/test_imports.py

+13%

519.2 ms*458.7 ms

test_import_time[tool]

libs/core/tests/benchmarks/test_imports.py

+13%

504.8 ms*447.2 ms

test_import_time[Document]

libs/core/tests/benchmarks/test_imports.py

+11%

184.8 ms*166.1 ms

test_import_time[BaseChatModel]

libs/core/tests/benchmarks/test_imports.py

+11%

510.7 ms*460.5 ms

test_import_time[ChatPromptTemplate]

libs/core/tests/benchmarks/test_imports.py

+11%

580.5 ms*524.1 ms

test_import_time[CallbackManager]

libs/core/tests/benchmarks/test_imports.py

+11%

446.1 ms*403.7 ms

test_import_time[HumanMessage]

libs/core/tests/benchmarks/test_imports.py

+10%

262.2 ms*237.3 ms

test_import_time[InMemoryVectorStore]

libs/core/tests/benchmarks/test_imports.py

+10%

592.4 ms*537.6 ms

Passed

test_import_time[RunnableLambda]

libs/core/tests/benchmarks/test_imports.py

+10%

477.5 ms*435.6 ms

test_import_time[InMemoryRateLimiter]

libs/core/tests/benchmarks/test_imports.py

+10%

172.7 ms*157.6 ms

test_import_time[Runnable]

libs/core/tests/benchmarks/test_imports.py

+9%

472.9 ms*432.1 ms

test_import_time[LangChainTracer]

libs/core/tests/benchmarks/test_imports.py

+9%

425.9 ms*390.1 ms

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIStandard

0%

1.2 s1.2 s

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_base_standard.py::TestOpenAIStandard

0%

1.2 s1.2 s

test_stream_time

libs/partners/openai/tests/integration_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

0%

858.1 ms857.8 ms

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_azure_standard.py::TestOpenAIStandard

0%

1.7 s1.7 s

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_base_standard.py::TestOpenAIStandard

0%

12.1 ms12.1 ms

test_init_time

libs/partners/openai/tests/unit_tests/chat_models/test_responses_standard.py::TestOpenAIResponses

0%

12.1 ms12.1 ms

Commits

Click on a commit to change the comparison range

Base

master

52b1516

+1.12%

feat/capture-raw-provider-response

394e21a

9 days ago

by AmazingcatAndrew

-2.3%

chore: update snapshots for raw_response field

304c7ad

3 days ago

by AmazingcatAndrew

-2.44%

fix lint errors

4a76d5f

3 days ago

by AmazingcatAndrew

+2.55%

test: add include_raw_response field to test_configurable

1a2dc46

3 days ago

by AmazingcatAndrew

+0.58%

test: add include_raw_response to test_configurable expected output(langchain)

e7d5e25

3 days ago

by AmazingcatAndrew

+0.02%

test: fix some lint errors

dcefbd8

3 days ago

by AmazingcatAndrew

+31.78%

fix(core): exclude raw_response from serialization by default

40d9386

3 days ago

by AmazingcatAndrew

© 2025 CodSpeed Technology

Home Terms Privacy Docs