carl-baillargeon:refactor/runner_limit - Branch - aristanetworks/anta

feat(anta): New AntaRunner class with limit concurrency

#680Merged

Comparing

carl-baillargeon:refactor/runner_limit

(

7b47562

) with

main

(

0231fa6

)

-1%

Improvements: 0

Regressions: 0

Untouched: 22

New: 4

Dropped: 0

Ignored: 0

Benchmarks

New

test__get_test_coroutines[1-device]

tests/benchmark/test_runner.py::test__get_test_coroutines[1-device]

N/A

40.4 ms

test__get_test_coroutines[2-devices]

tests/benchmark/test_runner.py::test__get_test_coroutines[2-devices]

N/A

79.6 ms

test__setup_tests[1-device]

tests/benchmark/test_runner.py::test__setup_tests[1-device]

N/A

23.2 ms

test__setup_tests[2-devices]

tests/benchmark/test_runner.py::test__setup_tests[2-devices]

N/A

23.4 ms

Passed

test_table_devices[1-device]

tests/benchmark/test_reporter.py::test_table_devices[1-device]

282.2 µs

281.2 µs

test_json[2-devices]

tests/benchmark/test_reporter.py::test_json[2-devices]

85.4 ms

85.1 ms

test_table_all[2-devices]

tests/benchmark/test_reporter.py::test_table_all[2-devices]

42.4 ms

test_jinja[2-devices]

tests/benchmark/test_reporter.py::test_jinja[2-devices]

124.6 ms

124.4 ms

test_csv[1-device]

tests/benchmark/test_reporter.py::test_csv[1-device]

21.6 ms

test_table_tests[2-devices]

tests/benchmark/test_reporter.py::test_table_tests[2-devices]

3.5 ms

test_csv[2-devices]

tests/benchmark/test_reporter.py::test_csv[2-devices]

42.8 ms

test_prepare_tests[1-device]

tests/benchmark/test_runner.py::test_prepare_tests[1-device]

23.2 ms

test_prepare_tests[2-devices]

tests/benchmark/test_runner.py::test_prepare_tests[2-devices]

23.2 ms

test_table_all[1-device]

tests/benchmark/test_reporter.py::test_table_all[1-device]

21.3 ms

test_markdown[2-devices]

tests/benchmark/test_reporter.py::test_markdown[2-devices]

20.8 ms

test_markdown[1-device]

tests/benchmark/test_reporter.py::test_markdown[1-device]

10.8 ms

10.9 ms

test_jinja[1-device]

tests/benchmark/test_reporter.py::test_jinja[1-device]

64.7 ms

64.9 ms

test_table_devices[2-devices]

tests/benchmark/test_reporter.py::test_table_devices[2-devices]

308.4 µs

309.9 µs

test_get_coroutines[2-devices]

tests/benchmark/test_runner.py::test_get_coroutines[2-devices]

-1%

83.7 ms

84.1 ms

test_get_coroutines[1-device]

tests/benchmark/test_runner.py::test_get_coroutines[1-device]

-1%

42.5 ms

42.8 ms

test_json[1-device]

tests/benchmark/test_reporter.py::test_json[1-device]

-1%

43.1 ms

43.4 ms

test_table_tests[1-device]

tests/benchmark/test_reporter.py::test_table_tests[1-device]

-1%

3.4 ms

test_anta[2-devices]

tests/benchmark/test_anta.py::test_anta[2-devices]

-1%

2.5 s

test_anta[1-device]

tests/benchmark/test_anta.py::test_anta[1-device]

-1%

1.2 s

1.3 s

test_anta_dry_run[1-device]

tests/benchmark/test_anta.py::test_anta_dry_run[1-device]

-7%

67.3 ms

72.8 ms

test_anta_dry_run[2-devices]

tests/benchmark/test_anta.py::test_anta_dry_run[2-devices]

-8%

110.9 ms

120.8 ms

Commits

Click on a commit to change the comparison range

Base

main

0231fa6

+0.67%

feat(anta): limit the number of tests run concurrently

83206e8

1 year ago

by carl-baillargeon

+0.22%

Merge branch 'main' into refactor/runner_limit

d86f85c

11 months ago

by gmuloc

-0.22%

test: Temporarily disable one benchmark

f2f3c6a

10 months ago

by gmuloc

-0.36%

Merge branch 'main' into refactor/runner_limit

0919b20

10 months ago

by gmuloc

+0.08%

Fix: Let's keep the artices

2ccc080

10 months ago

by gmuloc

+0.03%

Merge branch 'main' into refactor/runner_limit

c6bd59a

10 months ago

by gmuloc

-0.12%

Merge branch 'main' into refactor/runner_limit

ad22107

10 months ago

by gmuloc

-1.28%

Added None supports for timeouts

8bb7093

9 months ago

by carl-baillargeon

+0.73%

Fix unit tests

9d2e402

8 months ago

by carl-baillargeon

+0.3%

Fix unit tests again

4fb3c1b

8 months ago

by carl-baillargeon

-0.1%

Fix unit tests again

07c2454

8 months ago

by carl-baillargeon

-0.04%

Update scaling guide

996a23c

8 months ago

by carl-baillargeon

-0.12%

Conflicts

190f078

8 months ago

by carl-baillargeon

-0.02%

Fix unit tests

54af7e6

7 months ago

by carl-baillargeon

+0.01%

Fix manager

e72842b

7 months ago

by carl-baillargeon

-0.05%

Added deprecated decorator

4737b1f

7 months ago

by carl-baillargeon

-0.04%

Remove codspeed artifacts

a40c5c7

7 months ago

by carl-baillargeon

+0.13%

Merge branch 'main' into refactor/runner_limit

610d2a2

7 months ago

by mtache

+0.22%

Merge branch 'main' into refactor/runner_limit

5226028

7 months ago

by carl-baillargeon

-0.13%

Merge branch 'main' into refactor/runner_limit

9395a58

7 months ago

by gmuloc

-0.14%

Merge branch 'main' into refactor/runner_limit

216598a

7 months ago

by carl-baillargeon

+0.01%

Fix minor things

17b244a

7 months ago

by carl-baillargeon

-0.28%

Address more review comments

dee3bc9

7 months ago

by carl-baillargeon

+0.22%

Update doc for inf

9af6327

7 months ago

by carl-baillargeon

+0.18%

Update unit tests

e25826e

6 months ago

by carl-baillargeon

-0.27%

Fix unit tests for Windows

84fd77a

6 months ago

by carl-baillargeon

+0.23%

Update

9750d6c

6 months ago

by carl-baillargeon

-0.46%

Merge branch 'main' into refactor/runner_limit

545324d

6 months ago

by gmuloc

+0.16%

Merge branch 'main' into refactor/runner_limit

f211bb3

6 months ago

by gmuloc

-0.02%

Merge branch 'main' into refactor/runner_limit

e1ef766

6 months ago

by gmuloc

+0.19%

Merge branch 'main' into refactor/runner_limit

ba56964

6 months ago

by gmuloc

+0.01%

Merge branch 'main' into refactor/runner_limit

538c912

6 months ago

by gmuloc

-0.25%

Merge branch 'main' into refactor/runner_limit

79dabef

6 months ago

by gmuloc

+0.74%

Remove manager in generator

feda7a1

6 months ago

by carl-baillargeon

-0.09%

Fixes

6e4fdae

6 months ago

by carl-baillargeon

-0.17%

Sort results

6f69bd6

6 months ago

by carl-baillargeon

-0.78%

Update unit tests

421e5f0

6 months ago

by carl-baillargeon

-0.03%

Clean-up

b5304e7

6 months ago

by carl-baillargeon

+0.01%

Remove result file

ee92667

5 months ago

by carl-baillargeon

+0.07%

Update unit tests

adefdd3

5 months ago

by carl-baillargeon

-0.32%

Update per review comments

b273ffd

5 months ago

by carl-baillargeon

+0.26%

Pylint happy

7135745

5 months ago

by carl-baillargeon

+0.11%

Merge branch 'main' into refactor/runner_limit

8f691ee

5 months ago

by gmuloc

-0.2%

Merge branch 'main' into refactor/runner_limit

22017d3

5 months ago

by gmuloc

+0.06%

Update anta/settings.py

879d7b4

5 months ago

by gmuloc

+0.01%

Test: Add coverage

6b79b86

5 months ago

by gmuloc

-0.09%

Merge branch 'main' into refactor/runner_limit

459aeac

4 months ago

by gmuloc

+0.09%

Fix CI again

a7e27d4

4 months ago

by carl-baillargeon

-0.06%

Add unit tests

800f1b4

4 months ago

by carl-baillargeon

+0.04%

Update TODOs

323d85f

4 months ago

by carl-baillargeon

+0.11%

Remove TODOs comment

eb07dcf

4 months ago

by carl-baillargeon

-0.31%

Merge branch 'main' into refactor/runner_limit

2df3c73

4 months ago

by gmuloc

+0.07%

update docstring

a1ab311

4 months ago

by carl-baillargeon

-0.14%

Merge branch 'main' into refactor/runner_limit

2f787d4

4 months ago

by gmuloc

+0.2%

Review comments

7b47562

4 months ago

by carl-baillargeon

Home Terms Privacy Docs