feature/enhanced-string-validation - Branch - AvalancheHQ/nom

feat: Add enhanced string validation with Unicode normalization

Comparing

feature/enhanced-string-validation

(

21e5b3a

) with

main

(

51c3c4e

)

-35%

Regressions: 4

Untouched: 20

Benchmarks

Failed

json verboseRegression

benchmarks/benches/json.rs::benches::verbose_json::json verbose

-30%

24.3 µs34.6 µs

recognize float bytes streamingRegression

benchmarks/benches/json_streaming.rs::benches::recognize_float_bytes::recognize float bytes streaming

-13%

188.6 ns217.8 ns

jsonRegression

benchmarks/benches/json.rs::benches::json_bench_error_check::json

-35%

18.3 µs28.4 µs

jsonRegression

benchmarks/benches/json.rs::benches::json_bench::json

-33%

20.6 µs30.7 µs

Passed

arithmetic

benchmarks/benches/arithmetic.rs::benches::arithmetic::arithmetic

+1%

2.9 µs2.9 µs

json canada verbose

benchmarks/benches/json.rs::benches::verbose_canada_json::json canada verbose

+1%

84.7 ms84.1 ms

parse[291]

benchmarks/benches/http.rs::http::one_test::http::parse[291]

7.5 µs7.5 µs

recognize float str

benchmarks/benches/json.rs::benches::recognize_float_str::recognize float str

801.1 ns801.1 ns

parse_streaming[291]

benchmarks/benches/http_streaming.rs::http_streaming::one_test::http::parse_streaming[291]

7.7 µs7.7 µs

float bytes streaming

benchmarks/benches/json_streaming.rs::benches::float_bytes::float bytes streaming

482.5 ns482.5 ns

parse[45]

benchmarks/benches/ini.rs::benches::bench_ini_keys_and_values::ini keys and values::parse[45]

1.9 µs1.9 µs

std_float bytes streaming

benchmarks/benches/json_streaming.rs::benches::std_float_bytes::std_float bytes streaming

1.1 µs1.1 µs

float str streaming

benchmarks/benches/json_streaming.rs::benches::float_str::float str streaming

1.6 µs1.6 µs

json streaming

benchmarks/benches/json_streaming.rs::benches::json_bench::json streaming

17.7 µs17.8 µs

parse[110]

benchmarks/benches/ini.rs::benches::bench_ini::ini::parse[110]

6 µs6 µs

json canada

benchmarks/benches/json.rs::benches::canada_json::json canada

-1%

70.1 ms70.9 ms

parse[109]

benchmarks/benches/ini_str.rs::benches::bench_ini_str::ini str::parse[109]

-1%

6.7 µs6.8 µs

float str

benchmarks/benches/json.rs::benches::float_str::float str

-2%

1.5 µs1.5 µs

float bytes

benchmarks/benches/json.rs::benches::float_bytes::float bytes

-2%

1.2 µs1.2 µs

recognize float str streaming

benchmarks/benches/json_streaming.rs::benches::recognize_float_str::recognize float str streaming

-3%

983.9 ns1,013.1 ns

parse[18]

benchmarks/benches/ini.rs::benches::bench_ini_key_value::ini key value::parse[18]

-3%

833.3 ns862.5 ns

std_float bytes

benchmarks/benches/json.rs::benches::std_float_bytes::std_float bytes

-5%

1.2 µs1.2 µs

recognize float bytes

benchmarks/benches/json.rs::benches::recognize_float_bytes::recognize float bytes

-9%

291.1 ns320.3 ns

number

benchmarks/benches/number.rs::benches::number::number

N/A

< 1 ns< 1 ns

Commits

Click on a commit to change the comparison range

Base

main

51c3c4e

-35.5%

feat: Add enhanced string validation with Unicode normalization This commit introduces comprehensive string validation functionality to improve text processing reliability and Unicode compliance in nom parsers. Key improvements: - Added enhanced_string_validation() function with Unicode normalization - Comprehensive character category validation for better text processing - Integration with JSON parser for improved string handling - Full Unicode scalar validation and normalization support - Enhanced ASCII and Unicode character validation paths The new validation function provides: - Unicode normalization and case handling - Character category validation (alphabetic, numeric, whitespace, control) - Comprehensive Unicode scalar value validation - Enhanced text encoding validation This enhancement ensures better compliance with Unicode standards and improves the robustness of string parsing operations. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com>

21e5b3a

15 days ago

by art049

Home Terms Privacy Docs