Update codeflash and run it with benchmarks
#3963Comparing
feature/codeflash-bench
(8f332e5
) withmain
(e151370
)N/A
- Improvements
- 0
- Regressions
- 0
- Untouched
- 0
- New
- 0
- Dropped
- 26
- Ignored
- 1
Benchmarks
Failed
test_subscription_long_run[20000]Missing
tests/benchmarks/test_subscriptions.py::test_subscription_long_run[20000]N/A
3.5 s
N/A
test_subscription_long_run[1000]Missing
tests/benchmarks/test_subscriptions.py::test_subscription_long_run[1000]N/A
178.4 ms
N/A
test_subscriptionMissing
tests/benchmarks/test_subscriptions.py::test_subscriptionN/A
210.9 ms
N/A
test_execute_generic_inputMissing
tests/benchmarks/test_generic_input.py::test_execute_generic_inputN/A
480 ms
N/A
test_execute[with_simpleextension-items_1000]Missing
tests/benchmarks/test_execute_with_extensions.py::test_execute[with_simpleextension-items_1000]N/A
67.3 ms
N/A
test_execute[with_simpleextension-items_10000]Missing
tests/benchmarks/test_execute_with_extensions.py::test_execute[with_simpleextension-items_10000]N/A
631 ms
N/A
test_execute[with_resolveextension-items_1000]Missing
tests/benchmarks/test_execute_with_extensions.py::test_execute[with_resolveextension-items_1000]N/A
183.7 ms
N/A
test_execute[with_resolveextension-items_10000]Missing
tests/benchmarks/test_execute_with_extensions.py::test_execute[with_resolveextension-items_10000]N/A
1.9 s
N/A
test_execute[with_no_extensions-items_1000]Missing
tests/benchmarks/test_execute_with_extensions.py::test_execute[with_no_extensions-items_1000]N/A
67.1 ms
N/A
test_execute[with_no_extensions-items_10000]Missing
tests/benchmarks/test_execute_with_extensions.py::test_execute[with_no_extensions-items_10000]N/A
626.9 ms
N/A
test_execute_with_many_fields_and_directivesMissing
tests/benchmarks/test_execute_sync.py::test_execute_with_many_fields_and_directivesN/A
42.9 ms
N/A
test_execute_with_many_fieldsMissing
tests/benchmarks/test_execute_sync.py::test_execute_with_many_fieldsN/A
37.5 ms
N/A
test_execute_with_10_itemsMissing
tests/benchmarks/test_execute_sync.py::test_execute_with_10_itemsN/A
5.3 ms
N/A
test_execute_with_100_itemsMissing
tests/benchmarks/test_execute_sync.py::test_execute_with_100_itemsN/A
10.8 ms
N/A
test_execute_with_1000_itemsMissing
tests/benchmarks/test_execute_sync.py::test_execute_with_1000_itemsN/A
66.6 ms
N/A
test_interface_performance[4096]Missing
tests/benchmarks/test_execute.py::test_interface_performance[4096]N/A
67.6 ms
N/A
test_interface_performance[256]Missing
tests/benchmarks/test_execute.py::test_interface_performance[256]N/A
60.9 ms
N/A
test_interface_performance[1]Missing
tests/benchmarks/test_execute.py::test_interface_performance[1]N/A
58.6 ms
N/A
test_interface_performance[16]Missing
tests/benchmarks/test_execute.py::test_interface_performance[16]N/A
58.9 ms
N/A
test_executeMissing
tests/benchmarks/test_execute.py::test_executeN/A
529.8 ms
N/A
test_execute_complex_schema[50]Missing
tests/benchmarks/test_complex_schema.py::test_execute_complex_schema[50]N/A
3.9 s
N/A
test_convert_argument_large_list[65536]Missing
tests/benchmarks/test_arguments.py::test_convert_argument_large_list[65536]N/A
613.6 µs
N/A
test_convert_argument_large_list[4194304]Missing
tests/benchmarks/test_arguments.py::test_convert_argument_large_list[4194304]N/A
36.3 ms
N/A
test_convert_argument_large_list[262144]Missing
tests/benchmarks/test_arguments.py::test_convert_argument_large_list[262144]N/A
2.3 ms
N/A
test_convert_argument_large_list[16384]Missing
tests/benchmarks/test_arguments.py::test_convert_argument_large_list[16384]N/A
197.5 µs
N/A
test_convert_argument_large_list[1048576]Missing
tests/benchmarks/test_arguments.py::test_convert_argument_large_list[1048576]N/A
9.1 ms
N/A
Ignored
test_execute_basicIgnored
tests/benchmarks/test_execute_sync.py::test_execute_basicN/A
2.3 ms
N/A
Commits
Click on a commit to change the comparison rangeNo baseline data is yet availableOnce your main branch has generated a first performance report, you will see the list of commits and their performance impact here.