feat(anta): add test atomic results
#937Comparing
mtache:issue-427
(0503847
) withmain
(d57b53e
)-25%
- Improvements
- 4
- Regressions
- 4
- Untouched
- 14
- New
- 2
- Dropped
- 0
- Ignored
- 0
Benchmarks
Failed
test_anta_dry_run[1-device]Regression
tests/benchmark/test_anta.py::test_anta_dry_run[1-device]-18%
56.3 ms
69 ms
test_anta_dry_run[2-devices]Regression
tests/benchmark/test_anta.py::test_anta_dry_run[2-devices]-20%
97.6 ms
122.7 ms
test_get_coroutines[1-device]Regression
tests/benchmark/test_runner.py::test_get_coroutines[1-device]-25%
40.9 ms
54.2 ms
test_get_coroutines[2-devices]Regression
tests/benchmark/test_runner.py::test_get_coroutines[2-devices]-25%
80.6 ms
107.1 ms
Improved
test_json[2-devices]
tests/benchmark/test_reporter.py::test_json[2-devices]+63%
67.4 ms
41.4 ms
test_json[1-device]
tests/benchmark/test_reporter.py::test_json[1-device]+59%
34.4 ms
21.6 ms
test_jinja[2-devices]
tests/benchmark/test_reporter.py::test_jinja[2-devices]+14%
98.9 ms
86.9 ms
test_jinja[1-device]
tests/benchmark/test_reporter.py::test_jinja[1-device]+12%
52.1 ms
46.5 ms
New
test_table_expanded[1-device]
tests/benchmark/test_reporter.py::test_table_expanded[1-device]N/A
N/A
18.7 ms
test_table_expanded[2-devices]
tests/benchmark/test_reporter.py::test_table_expanded[2-devices]N/A
N/A
37.3 ms
Passed
test_table_all[1-device]
tests/benchmark/test_reporter.py::test_table_all[1-device]+3%
17.1 ms
16.6 ms
test_table_all[2-devices]
tests/benchmark/test_reporter.py::test_table_all[2-devices]+2%
33.8 ms
33.1 ms
test_markdown[2-devices]
tests/benchmark/test_reporter.py::test_markdown[2-devices]+1%
17.1 ms
16.9 ms
test_csv[2-devices]
tests/benchmark/test_reporter.py::test_csv[2-devices]0%
34.7 ms
34.5 ms
test_prepare_tests[1-device]
tests/benchmark/test_runner.py::test_prepare_tests[1-device]0%
14.1 ms
14.1 ms
test_prepare_tests[2-devices]
tests/benchmark/test_runner.py::test_prepare_tests[2-devices]0%
14.1 ms
14.2 ms
test_csv[1-device]
tests/benchmark/test_reporter.py::test_csv[1-device]0%
17.4 ms
17.5 ms
test_markdown[1-device]
tests/benchmark/test_reporter.py::test_markdown[1-device]0%
8.9 ms
8.9 ms
test_table_tests[1-device]
tests/benchmark/test_reporter.py::test_table_tests[1-device]-1%
3.1 ms
3.2 ms
test_table_tests[2-devices]
tests/benchmark/test_reporter.py::test_table_tests[2-devices]-1%
3.2 ms
3.3 ms
test_anta[1-device]
tests/benchmark/test_anta.py::test_anta[1-device]-2%
1 s
1 s
test_anta[2-devices]
tests/benchmark/test_anta.py::test_anta[2-devices]-2%
2 s
2.1 s
test_table_devices[1-device]
tests/benchmark/test_reporter.py::test_table_devices[1-device]-2%
282 µs
288.7 µs
test_table_devices[2-devices]
tests/benchmark/test_reporter.py::test_table_devices[2-devices]-3%
310.6 µs
320.6 µs
Commits
Click on a commit to change the comparison rangeBase
main
d57b53e
-26%
test: fix benchmark
c0cfda9
23 days ago
by mtache0%
fix: do not instantiate ta in reset()
1dc94de
15 days ago
by mtache0%
Merge branch 'main' into issue-427
34aceeb
15 days ago
by mtache+3%
fix: use InstanceOf for inputs in TestResult
b358c4e
15 days ago
by mtache0%
fix: test SkipValidation
42ead87
15 days ago
by mtache-21%
fix: test model_construct()
1e0a347
15 days ago
by mtache+21%
revert: do not use model_construct()
303ae12
14 days ago
by mtache-4%
fix: bad reference
9d3fe7b
14 days ago
by mtache+5%
fix: do not use model_construct() for TestResult
37bcfee
14 days ago
by mtache0%
fix: test SkipValidation again
c22cbd3
14 days ago
by mtache0%
Update anta/result_manager/__init__.py
Co-authored-by: Guillaume Mulocher <gmulocher@arista.com>
8064c61
14 days ago
by mtache0%
address comments on unit tests
5708ea3
14 days ago
by mtache0%
fix: remove SkipValidation
b7eed9e
14 days ago
by mtache0%
Addressing comments
76a9a86
14 days ago
by mtache0%
Adressing comments
caf684a
13 days ago
by mtache0%
Adressing comments
97679f3
13 days ago
by mtache-2%
refactor: fix 3.12 syntax
0503847
4 days ago
by mtache