mtache:issue-427 - Branch - aristanetworks/anta

feat(anta): add test atomic results

#937Closed

Comparing

mtache:issue-427

(

0503847

) with

main

(

d57b53e

)

-25%

Improvements: 4

Regressions: 4

Untouched: 14

New: 2

Benchmarks

Failed

test_anta_dry_run[1-device]Regression

tests/benchmark/test_anta.py::test_anta_dry_run[1-device]

-18%

56.3 ms69 ms

test_anta_dry_run[2-devices]Regression

tests/benchmark/test_anta.py::test_anta_dry_run[2-devices]

-20%

97.6 ms122.7 ms

test_get_coroutines[1-device]Regression

tests/benchmark/test_runner.py::test_get_coroutines[1-device]

-25%

40.9 ms54.2 ms

test_get_coroutines[2-devices]Regression

tests/benchmark/test_runner.py::test_get_coroutines[2-devices]

-25%

80.6 ms107.1 ms

Improved

test_json[2-devices]

tests/benchmark/test_reporter.py::test_json[2-devices]

+63%

67.4 ms41.4 ms

test_json[1-device]

tests/benchmark/test_reporter.py::test_json[1-device]

+59%

34.4 ms21.6 ms

test_jinja[2-devices]

tests/benchmark/test_reporter.py::test_jinja[2-devices]

+14%

98.9 ms86.9 ms

test_jinja[1-device]

tests/benchmark/test_reporter.py::test_jinja[1-device]

+12%

52.1 ms46.5 ms

New

test_table_expanded[2-devices]

tests/benchmark/test_reporter.py::test_table_expanded[2-devices]

N/A

N/A37.3 ms

test_table_expanded[1-device]

tests/benchmark/test_reporter.py::test_table_expanded[1-device]

N/A

N/A18.7 ms

Passed

test_table_all[1-device]

tests/benchmark/test_reporter.py::test_table_all[1-device]

+3%

17.1 ms16.6 ms

test_table_all[2-devices]

tests/benchmark/test_reporter.py::test_table_all[2-devices]

+2%

33.8 ms33.1 ms

test_markdown[2-devices]

tests/benchmark/test_reporter.py::test_markdown[2-devices]

+1%

17.1 ms16.9 ms

test_csv[2-devices]

tests/benchmark/test_reporter.py::test_csv[2-devices]

34.7 ms34.5 ms

test_prepare_tests[1-device]

tests/benchmark/test_runner.py::test_prepare_tests[1-device]

14.1 ms14.1 ms

test_prepare_tests[2-devices]

tests/benchmark/test_runner.py::test_prepare_tests[2-devices]

14.1 ms14.2 ms

test_csv[1-device]

tests/benchmark/test_reporter.py::test_csv[1-device]

17.4 ms17.5 ms

test_markdown[1-device]

tests/benchmark/test_reporter.py::test_markdown[1-device]

8.9 ms8.9 ms

test_table_tests[1-device]

tests/benchmark/test_reporter.py::test_table_tests[1-device]

-1%

3.1 ms3.2 ms

test_table_tests[2-devices]

tests/benchmark/test_reporter.py::test_table_tests[2-devices]

-1%

3.2 ms3.3 ms

test_anta[1-device]

tests/benchmark/test_anta.py::test_anta[1-device]

-2%

1 s1 s

test_anta[2-devices]

tests/benchmark/test_anta.py::test_anta[2-devices]

-2%

2 s2.1 s

test_table_devices[1-device]

tests/benchmark/test_reporter.py::test_table_devices[1-device]

-2%

282 µs288.7 µs

test_table_devices[2-devices]

tests/benchmark/test_reporter.py::test_table_devices[2-devices]

-3%

310.6 µs320.6 µs

Commits

Click on a commit to change the comparison range

Base

main

d57b53e

-25.95%

test: fix benchmark

c0cfda9

9 months ago

by mtache

+0.14%

fix: do not instantiate ta in reset()

1dc94de

9 months ago

by mtache

-0.06%

Merge branch 'main' into issue-427

34aceeb

9 months ago

by mtache

+2.53%

fix: use InstanceOf for inputs in TestResult

b358c4e

9 months ago

by mtache

-0.06%

fix: test SkipValidation

42ead87

9 months ago

by mtache

-21.36%

fix: test model_construct()

1e0a347

9 months ago

by mtache

+21.16%

revert: do not use model_construct()

303ae12

8 months ago

by mtache

-4.32%

fix: bad reference

9d3fe7b

8 months ago

by mtache

+4.89%

fix: do not use model_construct() for TestResult

37bcfee

8 months ago

by mtache

-0.02%

fix: test SkipValidation again

c22cbd3

8 months ago

by mtache

-0.02%

Update anta/result_manager/__init__.py Co-authored-by: Guillaume Mulocher <gmulocher@arista.com>

8064c61

8 months ago

by mtache

-0.5%

address comments on unit tests

5708ea3

8 months ago

by mtache

+0.29%

fix: remove SkipValidation

b7eed9e

8 months ago

by mtache

-0.09%

Addressing comments

76a9a86

8 months ago

by mtache

+0.26%

Adressing comments

caf684a

8 months ago

by mtache

-0.18%

Adressing comments

97679f3

8 months ago

by mtache

-1.51%

refactor: fix 3.12 syntax

0503847

8 months ago

by mtache

Home Terms Privacy Docs