micha/real-world-benchmarks - Branch - astral-sh/ruff

[ty] Add more benchmarks

#18714Merged

Comparing

micha/real-world-benchmarks

(

5cee3f0

) with

main

(

37fdece

)

Untouched: 34

New: 3

This report only contains results for the CPU Simulation instrument. To view results for the Wall Time instrument, click here.

Benchmarks

New

hydra-zen

crates/ruff_benchmark/benches/ty.rs::project::hydra::project

N/A

N/A719.7 ms

attrs

crates/ruff_benchmark/benches/ty.rs::project::attrs::project

N/A

N/A364.1 ms

anyio

crates/ruff_benchmark/benches/ty.rs::project::anyio::project

N/A

N/A878.6 ms

Passed

ty_check_file[incremental]

crates/ruff_benchmark/benches/ty.rs::check_file::benchmark_incremental

5.7 ms5.7 ms

linter/default-rules[numpy/globals.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

195.3 µs195.1 µs

formatter[numpy/globals.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

242.1 µs241.9 µs

lexer[unicode/pypinyin.py]

crates/ruff_benchmark/benches/lexer.rs::lexer::benchmark_lexer

75.3 µs75.2 µs

ty_check_file[cold]

crates/ruff_benchmark/benches/ty.rs::check_file::benchmark_cold

120.7 ms120.6 ms

lexer[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/lexer.rs::lexer::benchmark_lexer

218.3 µs218.2 µs

ty_micro[many_string_assignments]

crates/ruff_benchmark/benches/ty.rs::micro::benchmark_many_string_assignments

67.4 ms67.4 ms

ty_micro[many_tuple_assignments]

crates/ruff_benchmark/benches/ty.rs::micro::benchmark_many_tuple_assignments

181 ms180.9 ms

lexer[large/dataset.py]

crates/ruff_benchmark/benches/lexer.rs::lexer::benchmark_lexer

1.1 ms1.1 ms

linter/default-rules[large/dataset.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

4 ms4 ms

lexer[pydantic/types.py]

crates/ruff_benchmark/benches/lexer.rs::lexer::benchmark_lexer

488.3 µs488.2 µs

parser[numpy/globals.py]

crates/ruff_benchmark/benches/parser.rs::parser::benchmark_parser

105.8 µs105.8 µs

parser[pydantic/types.py]

crates/ruff_benchmark/benches/parser.rs::parser::benchmark_parser

2 ms2 ms

parser[large/dataset.py]

crates/ruff_benchmark/benches/parser.rs::parser::benchmark_parser

4.9 ms4.9 ms

linter/all-with-preview-rules[large/dataset.py]

crates/ruff_benchmark/benches/linter.rs::preview_rules::benchmark_preview_rules

20.5 ms20.5 ms

formatter[large/dataset.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

9.5 ms9.5 ms

parser[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/parser.rs::parser::benchmark_parser

930.8 µs930.8 µs

parser[unicode/pypinyin.py]

crates/ruff_benchmark/benches/parser.rs::parser::benchmark_parser

320.8 µs320.8 µs

formatter[unicode/pypinyin.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

664.2 µs664.3 µs

formatter[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

1.9 ms1.9 ms

formatter[pydantic/types.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

3.6 ms3.6 ms

linter/all-rules[large/dataset.py]

crates/ruff_benchmark/benches/linter.rs::all_rules::benchmark_all_rules

17 ms17 ms

linter/all-with-preview-rules[pydantic/types.py]

crates/ruff_benchmark/benches/linter.rs::preview_rules::benchmark_preview_rules

9.8 ms9.8 ms

linter/all-with-preview-rules[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/linter.rs::preview_rules::benchmark_preview_rules

4.8 ms4.8 ms

linter/default-rules[pydantic/types.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

2 ms2 ms

linter/all-rules[pydantic/types.py]

crates/ruff_benchmark/benches/linter.rs::all_rules::benchmark_all_rules

8.3 ms8.3 ms

linter/default-rules[unicode/pypinyin.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

378.4 µs378.8 µs

linter/all-rules[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/linter.rs::all_rules::benchmark_all_rules

4.1 ms4.1 ms

linter/default-rules[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

962.4 µs964 µs

linter/all-with-preview-rules[numpy/globals.py]

crates/ruff_benchmark/benches/linter.rs::preview_rules::benchmark_preview_rules

792.6 µs794 µs

lexer[numpy/globals.py]

crates/ruff_benchmark/benches/lexer.rs::lexer::benchmark_lexer

29 µs29.1 µs

linter/all-with-preview-rules[unicode/pypinyin.py]

crates/ruff_benchmark/benches/linter.rs::preview_rules::benchmark_preview_rules

2.1 ms2.1 ms

linter/all-rules[unicode/pypinyin.py]

crates/ruff_benchmark/benches/linter.rs::all_rules::benchmark_all_rules

1.8 ms1.8 ms

linter/all-rules[numpy/globals.py]

crates/ruff_benchmark/benches/linter.rs::all_rules::benchmark_all_rules

696 µs697.7 µs

Commits

Click on a commit to change the comparison range

Base

main

87f0feb

-0.02%

Add uv

e62bf33

5 months ago

by MichaReiser

+0.05%

Move to separate file, allow concurrent checking

6b0f777

5 months ago

by MichaReiser

+0.01%

Add different projects

7d58720

5 months ago

by MichaReiser

-0.11%

Use different projects

35d0e86

5 months ago

by MichaReiser

Add some logging

c2acebf

5 months ago

by MichaReiser

Speedup git clone

219d13f

5 months ago

by MichaReiser

Add colour_science

a78c609

5 months ago

by MichaReiser

+0.05%

Use walltime runner

7cdfea4

5 months ago

by MichaReiser

-0.01%

More projects

a669a2a

5 months ago

by MichaReiser

Reduce iterations for codspeed, disable multithreading

bf826ab

5 months ago

by MichaReiser

Use --quick

dac6ba0

5 months ago

by MichaReiser

-0.03%

Prewarm rayon

78c9f4c

5 months ago

by MichaReiser

Disable multithreading again

463284f

5 months ago

by MichaReiser

Fix sample size

a805bf0

5 months ago

by MichaReiser

Home Terms Privacy Docs