taearls:13991/improve-conformance-runner - Branch - oxc-project/oxc

refactor(coverage): optimize conformance runner infrastructure

#15736

Comparing

taearls:13991/improve-conformance-runner

(

61e8ab6

) with

main

(

f386efc

)

Untouched: 42

Skipped: 3

No successful run was found on main ( 0146b4c) during the generation of this report, so f386efc was used instead as the comparison base. There might be some changes unrelated to this pull request in this report.

Benchmarks

Skipped (3)

Passed

transformer[cal.com.tsx]

tasks/benchmark/benches/transformer.rs::transformer::bench_transformer

+2%

26.7 ms26.1 ms

mangler[RadixUIAdoptionSection.jsx]

tasks/benchmark/benches/minifier.rs::minifier::bench_mangler

+1%

13.5 µs13.3 µs

semantic[react.development.js]

tasks/benchmark/benches/semantic.rs::semantic::bench_semantic

1.6 ms1.6 ms

formatter[index.tsx]

tasks/benchmark/benches/formatter.rs::formatter::bench_formatter

4.8 ms4.8 ms

minifier[binder.ts]

tasks/benchmark/benches/minifier.rs::minifier::bench_minifier

4 ms4 ms

isolated-declarations[vue-id.ts]

tasks/benchmark/benches/transformer.rs::transformer::bench_isolated_declarations

56.9 ms56.9 ms

transformer[react.development.js]

tasks/benchmark/benches/transformer.rs::transformer::bench_transformer

717.9 µs717.5 µs

linter[RadixUIAdoptionSection.jsx]

tasks/benchmark/benches/linter.rs::linter::bench_linter

707.5 µs*707.3 µs

codegen[cal.com.tsx]

tasks/benchmark/benches/codegen.rs::codegen::bench_codegen

34 ms34 ms

linter[cal.com.tsx]

tasks/benchmark/benches/linter.rs::linter::bench_linter

464.9 ms*464.8 ms

formatter[handle-comments.js]

tasks/benchmark/benches/formatter.rs::formatter::bench_formatter

3.7 ms3.7 ms

semantic[RadixUIAdoptionSection.jsx]

tasks/benchmark/benches/semantic.rs::semantic::bench_semantic

71.8 µs71.8 µs

formatter[types.ts]

tasks/benchmark/benches/formatter.rs::formatter::bench_formatter

14.7 ms14.7 ms

parser[binder.ts]

tasks/benchmark/benches/parser.rs::parser::bench_parser

3.2 ms3.2 ms

linter[binder.ts]

tasks/benchmark/benches/linter.rs::linter::bench_linter

46.7 ms*46.7 ms

parser[cal.com.tsx]

tasks/benchmark/benches/parser.rs::parser::bench_parser

26 ms26 ms

lexer[RadixUIAdoptionSection.jsx]

tasks/benchmark/benches/lexer.rs::lexer::bench_lexer

20.9 µs20.9 µs

estree[checker.ts]

tasks/benchmark/benches/parser.rs::parser::bench_estree

104.6 ms104.6 ms

lexer[cal.com.tsx]

tasks/benchmark/benches/lexer.rs::lexer::bench_lexer

5.4 ms5.4 ms

lexer[binder.ts]

tasks/benchmark/benches/lexer.rs::lexer::bench_lexer

879.6 µs879.6 µs

parser[react.development.js]

tasks/benchmark/benches/parser.rs::parser::bench_parser

1.3 ms1.3 ms

formatter[next.ts]

tasks/benchmark/benches/formatter.rs::formatter::bench_formatter

3 ms3 ms

transformer[RadixUIAdoptionSection.jsx]

tasks/benchmark/benches/transformer.rs::transformer::bench_transformer

135.7 µs135.7 µs

formatter[App.tsx]

tasks/benchmark/benches/formatter.rs::formatter::bench_formatter

52.6 ms52.6 ms

formatter[Search.tsx]

tasks/benchmark/benches/formatter.rs::formatter::bench_formatter

2 ms2 ms

mangler[react.development.js]

tasks/benchmark/benches/minifier.rs::minifier::bench_mangler

267.4 µs267.5 µs

parser[RadixUIAdoptionSection.jsx]

tasks/benchmark/benches/parser.rs::parser::bench_parser

81.1 µs81.2 µs

formatter[core.js]

tasks/benchmark/benches/formatter.rs::formatter::bench_formatter

2.3 ms2.3 ms

lexer[react.development.js]

tasks/benchmark/benches/lexer.rs::lexer::bench_lexer

355.3 µs355.6 µs

minifier[react.development.js]

tasks/benchmark/benches/minifier.rs::minifier::bench_minifier

2.5 ms2.5 ms

mangler[cal.com.tsx]

tasks/benchmark/benches/minifier.rs::minifier::bench_mangler

2.9 ms2.9 ms

semantic[cal.com.tsx]

tasks/benchmark/benches/semantic.rs::semantic::bench_semantic

26.3 ms26.3 ms

mangler[binder.ts]

tasks/benchmark/benches/minifier.rs::minifier::bench_mangler

761.9 µs762.7 µs

formatter[RadixUIAdoptionSection.jsx]

tasks/benchmark/benches/formatter.rs::formatter::bench_formatter

491 µs491.6 µs

semantic[binder.ts]

tasks/benchmark/benches/semantic.rs::semantic::bench_semantic

4 ms4.1 ms

transformer[binder.ts]

tasks/benchmark/benches/transformer.rs::transformer::bench_transformer

1.7 ms1.7 ms

linter[react.development.js]

tasks/benchmark/benches/linter.rs::linter::bench_linter

18.7 ms*18.8 ms

formatter[errors.ts]

tasks/benchmark/benches/formatter.rs::formatter::bench_formatter

814.5 µs815.9 µs

codegen[react.development.js]

tasks/benchmark/benches/codegen.rs::codegen::bench_codegen

1.9 ms1.9 ms

minifier[cal.com.tsx]

tasks/benchmark/benches/minifier.rs::minifier::bench_minifier

36.1 ms36.2 ms

codegen[RadixUIAdoptionSection.jsx]

tasks/benchmark/benches/codegen.rs::codegen::bench_codegen

-2%

120.5 µs122.6 µs

codegen[binder.ts]

tasks/benchmark/benches/codegen.rs::codegen::bench_codegen

-2%

4.2 ms4.3 ms

Commits

Click on a commit to change the comparison range

Base

main

f386efc

-0.06%

refactor(coverage): Migrate conformance runner to ETL architecture This commit refactors the coverage conformance runner from a legacy Case/Suite trait system to a clean ETL (Extract-Transform-Load) architecture. ## Architecture Changes ### New ETL Pipeline - **Extract**: FileDiscovery with path caching for efficient test discovery - **Transform**: MetadataParser trait for suite-specific metadata extraction - **Load**: TestRunner trait with sync/async execution support - **Validate**: ResultValidator trait for flexible result handling ### New Modules - `pipeline.rs` - Unified test execution pipeline with rayon parallelization - `registry.rs` - Declarative suite configuration (SuiteDefinition, SuiteConfig) - `reporter.rs` - Coverage statistics and snapshot generation - `tools/parser.rs` - ParserRunner implementation ### Tool Migrations All tools migrated to TestRunner trait: - ParserRunner, CodegenRunner, SemanticRunner - FormatterRunner, TransformerRunner, MinifierRunner - EstreeRunner (with async support), RuntimeRunner - TranspileRunner (with custom TranspileValidator) ### Filter System - PathBasedFilter for directory/path exclusions - SkipFailingFilter wrapper for tools that skip negative tests - Suite-specific filters (Test262Filter, BabelFilter, etc.) - Tool-specific filters (MinifierTest262Filter, SemanticFilter) ### Removed Legacy Code - Case trait and all implementations (Test262Case, BabelCase, etc.) - Legacy Suite infrastructure ## Benefits - Cleaner separation of concerns - Better composability and testability - Reduced code duplication across tools - Type-safe error handling with ErrorKind enum - Unified reporting and snapshot generation 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com>

61e8ab6

1 hour ago

by taearls

Home Terms Privacy Docs