partial-json-partial-strings - Branch - pydantic/jiter

Partial JSON parsing support trailing strings

#101Merged

Comparing

partial-json-partial-strings

(

ef1b244

) with

main

(

240f180

)

+17%

Improvements: 2

Regressions: 0

Untouched: 71

New: 0

Dropped: 0

Ignored: 0

Benchmarks

Improved

x100_jiter_iter

crates/jiter/benches/main.rs::x100_jiter_iter

+17%

1.4 µs

1.2 µs

x100_jiter_value

crates/jiter/benches/main.rs::x100_jiter_value

+11%

1.7 µs

1.5 µs

Passed

unicode_jiter_value

crates/jiter/benches/main.rs::unicode_jiter_value

+8%

9.4 µs

8.7 µs

python_parse_string_array_not_cached

crates/jiter/benches/python.rs::python_parse_string_array_not_cached

+8%

40.2 µs

37.3 µs

python_parse_massive_ints_array

crates/jiter/benches/python.rs::python_parse_massive_ints_array

+7%

1.3 ms

1.2 ms

unicode_jiter_iter

crates/jiter/benches/main.rs::unicode_jiter_iter

+5%

8.7 µs

8.3 µs

pass2_jiter_value

crates/jiter/benches/main.rs::pass2_jiter_value

+5%

23.1 µs

22 µs

pass2_jiter_iter

crates/jiter/benches/main.rs::pass2_jiter_iter

+4%

6.7 µs

6.4 µs

python_parse_x100

crates/jiter/benches/python.rs::python_parse_x100

+4%

3.8 µs

3.6 µs

sentence_serde_value

crates/jiter/benches/main.rs::sentence_serde_value

+4%

9.3 µs

9 µs

python_parse_x100_not_cached

crates/jiter/benches/python.rs::python_parse_x100_not_cached

+3%

3.6 µs

3.5 µs

pass2_serde_value

crates/jiter/benches/main.rs::pass2_serde_value

+3%

16 µs

15.5 µs

string_array_jiter_iter

crates/jiter/benches/main.rs::string_array_jiter_iter

+3%

8.5 µs

8.2 µs

x100_serde_value

crates/jiter/benches/main.rs::x100_serde_value

+2%

3.7 µs

3.6 µs

medium_response_jiter_value

crates/jiter/benches/main.rs::medium_response_jiter_value

+2%

42.4 µs

41.6 µs

pass1_jiter_value

crates/jiter/benches/main.rs::pass1_jiter_value

+2%

37.6 µs

37 µs

true_object_jiter_value

crates/jiter/benches/main.rs::true_object_jiter_value

+1%

30.9 µs

30.6 µs

true_object_jiter_iter

crates/jiter/benches/main.rs::true_object_jiter_iter

+1%

21.4 µs

21.2 µs

string_array_jiter_value_owned

crates/jiter/benches/main.rs::string_array_jiter_value_owned

+1%

41.5 µs

41.1 µs

big_serde_value

crates/jiter/benches/main.rs::big_serde_value

+1%

208.6 ms

206.5 ms

python_parse_true_object

crates/jiter/benches/python.rs::python_parse_true_object

+1%

53.7 µs

53.2 µs

lazy_map_lookup_2_20

crates/jiter/benches/main.rs::lazy_map_lookup_2_20

+1%

25.4 µs

25.2 µs

big_jiter_value

crates/jiter/benches/main.rs::big_jiter_value

+1%

52.4 ms

51.9 ms

pass2_jiter_skip

crates/jiter/benches/main.rs::pass2_jiter_skip

+1%

3.4 µs

python_parse_medium_response_not_cached

crates/jiter/benches/python.rs::python_parse_medium_response_not_cached

+1%

65.2 µs

64.7 µs

medium_response_jiter_value_owned

crates/jiter/benches/main.rs::medium_response_jiter_value_owned

+1%

56.7 µs

56.2 µs

python_parse_medium_response

crates/jiter/benches/python.rs::python_parse_medium_response

+1%

54.4 µs

54 µs

medium_response_serde_value

crates/jiter/benches/main.rs::medium_response_serde_value

+1%

86.3 µs

85.7 µs

python_parse_numeric

crates/jiter/benches/python.rs::python_parse_numeric

+1%

13.6 µs

13.5 µs

true_array_jiter_skip

crates/jiter/benches/main.rs::true_array_jiter_skip

+1%

4.9 µs

true_array_serde_value

crates/jiter/benches/main.rs::true_array_serde_value

+1%

24 µs

23.9 µs

string_array_jiter_value

crates/jiter/benches/main.rs::string_array_jiter_value

20.3 µs

20.2 µs

pass1_serde_value

crates/jiter/benches/main.rs::pass1_serde_value

71.9 µs

71.6 µs

big_jiter_skip

crates/jiter/benches/main.rs::big_jiter_skip

19.7 ms

19.6 ms

lazy_map_lookup_1_10

crates/jiter/benches/main.rs::lazy_map_lookup_1_10

8.9 µs

python_parse_string_array_unique_not_cached

crates/jiter/benches/python.rs::python_parse_string_array_unique_not_cached

3.7 ms

lazy_map_lookup_3_50

crates/jiter/benches/main.rs::lazy_map_lookup_3_50

52.1 µs

52 µs

short_numbers_serde_value

crates/jiter/benches/main.rs::short_numbers_serde_value

557.9 µs

556.9 µs

bigints_array_serde_value

crates/jiter/benches/main.rs::bigints_array_serde_value

740.2 µs

738.9 µs

string_array_serde_value

crates/jiter/benches/main.rs::string_array_serde_value

50.8 µs

50.7 µs

massive_ints_array_serde_value

crates/jiter/benches/main.rs::massive_ints_array_serde_value

2.3 ms

floats_array_jiter_iter

crates/jiter/benches/main.rs::floats_array_jiter_iter

184.6 µs

python_parse_string_array_unique

crates/jiter/benches/python.rs::python_parse_string_array_unique

2.3 ms

floats_array_serde_value

crates/jiter/benches/main.rs::floats_array_serde_value

1.2 ms

massive_ints_array_jiter_iter

crates/jiter/benches/main.rs::massive_ints_array_jiter_iter

567 µs

massive_ints_array_jiter_skip

crates/jiter/benches/main.rs::massive_ints_array_jiter_skip

225.1 µs

true_array_jiter_iter

crates/jiter/benches/main.rs::true_array_jiter_iter

4.9 µs

bigints_array_jiter_iter

crates/jiter/benches/main.rs::bigints_array_jiter_iter

126.4 µs

126.5 µs

floats_array_jiter_skip

crates/jiter/benches/main.rs::floats_array_jiter_skip

108.2 µs

massive_ints_array_jiter_value

crates/jiter/benches/main.rs::massive_ints_array_jiter_value

780.9 µs

781.2 µs

short_numbers_jiter_skip

crates/jiter/benches/main.rs::short_numbers_jiter_skip

61 µs

bigints_array_jiter_skip

crates/jiter/benches/main.rs::bigints_array_jiter_skip

95.2 µs

95.3 µs

unicode_jiter_skip

crates/jiter/benches/main.rs::unicode_jiter_skip

2.2 µs

unicode_serde_value

crates/jiter/benches/main.rs::unicode_serde_value

10 µs

floats_array_jiter_value

crates/jiter/benches/main.rs::floats_array_jiter_value

313.3 µs

313.7 µs

bigints_array_jiter_value

crates/jiter/benches/main.rs::bigints_array_jiter_value

218.1 µs

218.5 µs

short_numbers_jiter_value

crates/jiter/benches/main.rs::short_numbers_jiter_value

169 µs

169.3 µs

big_jiter_iter

crates/jiter/benches/main.rs::big_jiter_iter

37.4 ms

37.5 ms

pass1_jiter_skip

crates/jiter/benches/main.rs::pass1_jiter_skip

13.5 µs

medium_response_jiter_skip

crates/jiter/benches/main.rs::medium_response_jiter_skip

-1%

17 µs

17.1 µs

true_object_jiter_skip

crates/jiter/benches/main.rs::true_object_jiter_skip

-1%

12.4 µs

true_object_serde_value

crates/jiter/benches/main.rs::true_object_serde_value

-1%

78.1 µs

78.6 µs

python_parse_other

crates/jiter/benches/python.rs::python_parse_other

-1%

6.6 µs

6.7 µs

python_parse_true_object_not_cached

crates/jiter/benches/python.rs::python_parse_true_object_not_cached

-1%

71.1 µs

71.8 µs

x100_serde_iter

crates/jiter/benches/main.rs::x100_serde_iter

-1%

3 µs

true_array_jiter_value

crates/jiter/benches/main.rs::true_array_jiter_value

-1%

16.6 µs

16.8 µs

sentence_jiter_skip

crates/jiter/benches/main.rs::sentence_jiter_skip

-1%

2.1 µs

string_array_jiter_skip

crates/jiter/benches/main.rs::string_array_jiter_skip

-2%

7.5 µs

7.6 µs

python_parse_string_array

crates/jiter/benches/python.rs::python_parse_string_array

-2%

26.3 µs

26.8 µs

x100_jiter_skip

crates/jiter/benches/main.rs::x100_jiter_skip

-3%

1.1 µs

1.2 µs

sentence_jiter_value

crates/jiter/benches/main.rs::sentence_jiter_value

-3%

8.4 µs

8.7 µs

python_parse_true_array

crates/jiter/benches/python.rs::python_parse_true_array

-5%

15.8 µs

16.7 µs

sentence_jiter_iter

crates/jiter/benches/main.rs::sentence_jiter_iter

-5%

7.2 µs

7.7 µs

Commits

Click on a commit to change the comparison range

Base

main

240f180

+10%

add Jiter.with_allow_inf_nan and with_allow_partial_strings

bc8b7b6

10 months ago

by samuelcolvin

-21%

add PartialMode

23fb3aa

10 months ago

by samuelcolvin

fix docstrings

fdc07ac

10 months ago

by samuelcolvin

+11%

avoid impl into PartialMode

ccc9b07

10 months ago

by samuelcolvin

-16%

Merge branch 'main' into partial-json-partial-strings

4d97eb8

10 months ago

by samuelcolvin

bump

161d68b

10 months ago

by samuelcolvin

+28%

add codecov token

fc96580

10 months ago

by samuelcolvin

+5%

Merge branch 'main' into partial-json-partial-strings

18d9e5e

10 months ago

by samuelcolvin

-32%

rename kwargs and PythonParse

2bb9fc1

10 months ago

by samuelcolvin

+34%

add coverage for python package

26b2c2e

10 months ago

by samuelcolvin

-34%

fix tests

60347cf

10 months ago

by samuelcolvin

+32%

try using pip install -e

ef1b244

10 months ago

by samuelcolvin

Home Terms Privacy Docs