chinar-amrutkar:feat/notebook-cell-boundary-lexer - Branch - astral-sh/ruff

[parser] Reset lexer state at notebook cell boundaries

#24163

Comparing

chinar-amrutkar:feat/notebook-cell-boundary-lexer

(

82e85e1

) with

main

(

6e76b4c

)

Untouched: 58

Benchmarks

58 total

pydantic

crates/ruff_benchmark/benches/ty_walltime.rs

+1%

7.3 s7.2 s

pandas

crates/ruff_benchmark/benches/ty_walltime.rs

+1%

69.5 s68.8 s

tanjun

crates/ruff_benchmark/benches/ty_walltime.rs

+1%

2.9 s2.9 s

static_frame

crates/ruff_benchmark/benches/ty_walltime.rs

+1%

21.4 s21.3 s

freqtrade

crates/ruff_benchmark/benches/ty_walltime.rs

7.9 s7.9 s

linter/default-rules[unicode/pypinyin.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

416.6 µs414.7 µs

sympy

crates/ruff_benchmark/benches/ty_walltime.rs

62.7 s62.4 s

colour_science

crates/ruff_benchmark/benches/ty_walltime.rs

58.6 s58.5 s

linter/default-rules[numpy/globals.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

213.6 µs213.1 µs

altair

crates/ruff_benchmark/benches/ty_walltime.rs

5.1 s5.1 s

linter/default-rules[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

1 ms1 ms

linter/default-rules[large/dataset.py]

crates/ruff_benchmark/benches/linter.rs::default_rules::benchmark_default_rules

4.3 ms4.3 ms

ty_check_file[incremental]

crates/ruff_benchmark/benches/ty.rs::check_file::benchmark_incremental

8.2 ms8.2 ms

ty_micro[many_enum_members_2]

crates/ruff_benchmark/benches/ty.rs::micro::benchmark_many_enum_members_2

173.5 ms173.4 ms

formatter[unicode/pypinyin.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

682.9 µs682.8 µs

formatter[numpy/ctypeslib.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

1.9 ms1.9 ms

hydra-zen

crates/ruff_benchmark/benches/ty.rs::project::hydra::project

1.1 s1.1 s

formatter[large/dataset.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

9.4 ms9.4 ms

anyio

crates/ruff_benchmark/benches/ty.rs::project::anyio::project

1.2 s1.2 s

formatter[numpy/globals.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

246 µs246 µs

linter/all-rules[numpy/globals.py]

crates/ruff_benchmark/benches/linter.rs::all_rules::benchmark_all_rules

754.5 µs754.7 µs

formatter[pydantic/types.py]

crates/ruff_benchmark/benches/formatter.rs::formatter::benchmark_formatter

3.6 ms3.6 ms

attrs

crates/ruff_benchmark/benches/ty.rs::project::attrs::project

469.1 ms469.3 ms

ty_check_file[cold]

crates/ruff_benchmark/benches/ty.rs::check_file::benchmark_cold

152.3 ms152.3 ms

DateType

crates/ruff_benchmark/benches/ty.rs::project::datetype::project

224.2 ms224.3 ms

Commits

Click on a commit to change the comparison range

Base

main

6e76b4c

-15.52%

[parser] Use cursor-driven cell boundary detection

c7fd95d

2 days ago

by chinar-amrutkar

-0.14%

perf: skip cell boundary check on hot path for non-notebook files

de675bb

22 hours ago

by chinar-amrutkar

fix: cargo fmt

24ee5b3

22 hours ago

by chinar-amrutkar

+9.56%

fix: remove dead current_cell field from LexerCheckpoint

df3903a

19 hours ago

by chinar-amrutkar

-0.02%

fix: remove stale clippy cast_possible_truncation expectation

f31f159

19 hours ago

by chinar-amrutkar

+5.25%

chore: remove debug tests

70b3033

12 hours ago

by chinar-amrutkar

-7.06%

fix: thread cell_offsets through Parser constructor

6ad5518

9 hours ago

by chinar-amrutkar

+0.86%

perf: precompute cell_end_offset to avoid extra add per token

a99a5b0

9 hours ago

by chinar-amrutkar

+0.7%

perf: restrict cell-boundary range fixup to EOF/Dedent tokens

fe10c10

8 hours ago

by chinar-amrutkar

+6.15%

perf: mark consume_end and advance_to_next_cell as cold/inline(never)

82e85e1

8 hours ago

by chinar-amrutkar

Home Terms Privacy Docs