mtshiba:improve-edit-distance - Branch - astral-sh/ruff

[ty] improve "Did you mean?" suggestion selection algorithm

#21808Closed

Comparing

mtshiba:improve-edit-distance

(

e553bcf

) with

main

(

3deb7e1

)

-12%

Regressions: 2

Untouched: 11

Skipped: 30

Archived: 9

Benchmarks

9 archived benchmarks were run. If they were deleted in another branch, consider rebasing to remove them from the report. .

Skipped (30)

These benchmarks were skipped, so their baseline results are used instead. If they were deleted in your codebase, archive them to remove them from the performance reports.
Learn more about archiving benchmarks

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/all-with-preview-rules[large/dataset.py]

crates/ruff_benchmark/benches/linter.rs::preview_rules::benchmark_preview_rules

Skipped

22.8 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

formatter[large/dataset.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

Skipped

9.7 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

parser[large/dataset.py]

crates/ruff_benchmark/benches/parser.rs::parser::benchmark_parser

Skipped

5.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/default-rules[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

Skipped

1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/default-rules[pydantic/types.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

Skipped

2.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

formatter[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

Skipped

1.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/default-rules[numpy/globals.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

Skipped

210.2 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

parser[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/parser.rs::parser::benchmark_parser

Skipped

947.8 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

parser[numpy/globals.py]

crates/ruff_benchmark/benches/parser.rs::parser::benchmark_parser

Skipped

108.4 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

formatter[numpy/globals.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

Skipped

248.7 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/default-rules[unicode/pypinyin.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

Skipped

410.5 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

parser[unicode/pypinyin.py]

crates/ruff_benchmark/benches/parser.rs::parser::benchmark_parser

Skipped

329 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/all-with-preview-rules[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/linter.rs::preview_rules::benchmark_preview_rules

Skipped

5.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/all-with-preview-rules[unicode/pypinyin.py]

crates/ruff_benchmark/benches/linter.rs::preview_rules::benchmark_preview_rules

Skipped

2.3 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

parser[pydantic/types.py]

crates/ruff_benchmark/benches/parser.rs::parser::benchmark_parser

Skipped

2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/all-with-preview-rules[pydantic/types.py]

crates/ruff_benchmark/benches/linter.rs::preview_rules::benchmark_preview_rules

Skipped

10.2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

formatter[unicode/pypinyin.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

Skipped

677.9 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/all-with-preview-rules[numpy/globals.py]

crates/ruff_benchmark/benches/linter.rs::preview_rules::benchmark_preview_rules

Skipped

835.1 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

lexer[pydantic/types.py]

crates/ruff_benchmark/benches/lexer.rs::lexer::benchmark_lexer

Skipped

496.8 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

formatter[pydantic/types.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

Skipped

3.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/all-rules[pydantic/types.py]

crates/ruff_benchmark/benches/linter.rs::all_rules::benchmark_all_rules

Skipped

8.6 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/default-rules[large/dataset.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

Skipped

4.4 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/all-rules[numpy/globals.py]

crates/ruff_benchmark/benches/linter.rs::all_rules::benchmark_all_rules

Skipped

735 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

lexer[large/dataset.py]

crates/ruff_benchmark/benches/lexer.rs::lexer::benchmark_lexer

Skipped

1.1 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

lexer[numpy/globals.py]

crates/ruff_benchmark/benches/lexer.rs::lexer::benchmark_lexer

Skipped

29.7 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/all-rules[large/dataset.py]

crates/ruff_benchmark/benches/linter.rs::all_rules::benchmark_all_rules

Skipped

18.9 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/all-rules[unicode/pypinyin.py]

crates/ruff_benchmark/benches/linter.rs::all_rules::benchmark_all_rules

Skipped

2 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

linter/all-rules[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/linter.rs::all_rules::benchmark_all_rules

Skipped

4.4 ms*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

lexer[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/lexer.rs::lexer::benchmark_lexer

Skipped

222.6 µs*

Uses the CPU Simulation instrument
to collect CPU performance metrics.

lexer[unicode/pypinyin.py]

crates/ruff_benchmark/benches/lexer.rs::lexer::benchmark_lexer

Skipped

77.4 µs*

Failed

Uses the CPU Simulation instrument
to collect CPU performance metrics.

ty_micro[complex_constrained_attributes_1]

crates/ruff_benchmark/benches/ty.rs::micro::benchmark_complex_constrained_attributes_1

Regression

-8%

67.3 ms72.9 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

attrs

crates/ruff_benchmark/benches/ty.rs::project::attrs::project

Regression

-5%

448.7 ms474.4 ms

Passed

Uses the CPU Simulation instrument
to collect CPU performance metrics.

ty_micro[many_enum_members]

crates/ruff_benchmark/benches/ty.rs::micro::benchmark_many_enum_members

125.6 ms126 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

ty_check_file[incremental]

crates/ruff_benchmark/benches/ty.rs::check_file::benchmark_incremental

6.9 ms6.9 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

ty_check_file[cold]

crates/ruff_benchmark/benches/ty.rs::check_file::benchmark_cold

137.2 ms137.7 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

ty_micro[many_string_assignments]

crates/ruff_benchmark/benches/ty.rs::micro::benchmark_many_string_assignments

85 ms85.4 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

hydra-zen

crates/ruff_benchmark/benches/ty.rs::project::hydra::project

-1%

1.1 s1.1 s

Uses the CPU Simulation instrument
to collect CPU performance metrics.

ty_micro[many_tuple_assignments]

crates/ruff_benchmark/benches/ty.rs::micro::benchmark_many_tuple_assignments

-1%

65.9 ms66.3 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

ty_micro[many_tuple_assignments]

crates/ruff_benchmark/benches/ty.rs::micro::benchmark_tuple_implicit_instance_attributes

-1%

67.4 ms67.8 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

ty_micro[complex_constrained_attributes_3]

crates/ruff_benchmark/benches/ty.rs::micro::benchmark_complex_constrained_attributes_3

-1%

71.2 ms71.6 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

ty_micro[complex_constrained_attributes_2]

crates/ruff_benchmark/benches/ty.rs::micro::benchmark_complex_constrained_attributes_2

-1%

67.1 ms67.6 ms

Uses the CPU Simulation instrument
to collect CPU performance metrics.

anyio

crates/ruff_benchmark/benches/ty.rs::project::anyio::project

-1%

1.4 s1.4 s

Uses the CPU Simulation instrument
to collect CPU performance metrics.

DateType

crates/ruff_benchmark/benches/ty.rs::project::datetype::project

-1%

255.2 ms258.3 ms

Commits

Click on a commit to change the comparison range

Base

main

3deb7e1

-0.29%

[ty] "Did you mean?" suggestions on typos for stdlib imports (with improved edit distance algorithm) Co-Authored-By: Alex Waygood <Alex.Waygood@Gmail.com>

8c4c3c3

1 month ago

by mtshiba

+0.36%

update snapshots

3c60658

1 month ago

by mtshiba

-0.54%

filter by `wrong_name` length

a1cc3db

1 month ago

by mtshiba

+0.55%

focus only on improving "did_you_mean"

f8d4142

1 month ago

by mtshiba

-12.22%

experiment: unresolved attribute suggestion

e553bcf

1 month ago

by mtshiba

Home Terms Privacy Docs