BlogDocs

[BUG] Check env in benchmarking script(#3297)

Merged
Comparing
colin/fix-benchmarking-script
(
1d52ee2
) with
main
(
711e862
)
-48%
IMPROVEMENTS
0
REGRESSIONS
2
UNTOUCHED
15
NEW
0
DROPPED
0
IGNORED
1

Benchmarks

Failed

test_iter_rows_first_row[100 Small Files]Regression
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[100 Small Files]
-28%
269 ms
373.6 ms
test_show[100 Small Files]Regression
tests/benchmarks/test_interactive_reads.py::test_show[100 Small Files]
-48%
22.3 ms
42.5 ms

Passed

test_count[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_count[1 Small File]
+2%
3.6 ms
3.5 ms
test_tpch[1-in-memory-native-2]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-2]
+1%
99.5 ms
98.1 ms
test_tpch[1-in-memory-native-9]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-9]
+1%
375.6 ms
370.7 ms
test_tpch[1-in-memory-native-6]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-6]
0%
28.7 ms
28.7 ms
test_tpch[1-in-memory-native-10]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-10]
0%
192.6 ms
192.7 ms
test_tpch[1-in-memory-native-5]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-5]
0%
378.4 ms
379.9 ms
test_iter_rows_first_row[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_iter_rows_first_row[1 Small File]
0%
101.3 ms
101.7 ms
test_tpch[1-in-memory-native-1]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-1]
-1%
442.7 ms
445.6 ms
test_tpch[1-in-memory-native-8]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-8]
-1%
340 ms
342.6 ms
test_tpch[1-in-memory-native-4]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-4]
-1%
143.6 ms
144.8 ms
test_tpch[1-in-memory-native-3]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-3]
-1%
140.3 ms
141.9 ms
test_tpch[1-in-memory-native-7]
tests/benchmarks/test_local_tpch.py::test_tpch[1-in-memory-native-7]
-1%
133.2 ms
135 ms
test_count[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_count[100 Small Files]
-2%
70.2 ms
71.4 ms
test_show[1 Small File]
tests/benchmarks/test_interactive_reads.py::test_show[1 Small File]
-3%
11.6 ms
12 ms
test_explain[100 Small Files]
tests/benchmarks/test_interactive_reads.py::test_explain[100 Small Files]
-5%
7.1 ms
7.5 ms

Ignored

test_explain[1 Small File]Ignored
tests/benchmarks/test_interactive_reads.py::test_explain[1 Small File]
0%
1.9 ms
2 ms

Commits

Click on a commit to change the comparison range
base
main
711e862
-46%
check env not runner
945e1b6
8 days ago
+14%
no address
fab8773
8 days ago
-15%
dont create runner in metrics builder
1d52ee2
8 days ago
ResourcesHomePricingDocsBlogGitHubChangelog
Getting StartedSample repositoryExplore repositoriesSupport
AboutCareersTwitterDiscordContact UsTerms of ServicePrivacy Policy
Copyright © 2024 CodSpeed Technology SAS. All rights reserved.