woustachemax:fix-encoding-canonical-names - Branch - cloudflare/workerd

Fix encoding canonical names to match WHATWG spec

#5853

Comparing

woustachemax:fix-encoding-canonical-names

(

2977ef0

) with

main

(

6bacc75

)

-19%

Regressions: 1

Untouched: 128

Skipped: 49

Benchmarks

Skipped (49)

Failed

jsonResponse[Response]

src/workerd/tests/bench-response.c++

Regression

-19%

34.6 µs42.7 µs

Passed

New_Small_Byte_HWM16K

src/workerd/tests/bench-stream-piping.c++

+1%

1.9 ms1.9 ms

Existing_Tiny_Byte_HWM16K

src/workerd/tests/bench-stream-piping.c++

+1%

3 ms3 ms

New_Small_Timed1ms

src/workerd/tests/bench-stream-piping.c++

+1%

3.6 ms3.6 ms

New_Tiny_Byte_Auto64K_HWM16K

src/workerd/tests/bench-stream-piping.c++

2.8 ms2.8 ms

New_Medium_SlowValue

src/workerd/tests/bench-stream-piping.c++

3.4 ms3.4 ms

Existing_Small_IoLatencyByte

src/workerd/tests/bench-stream-piping.c++

7.5 ms7.5 ms

New_Medium_IoLatencyValue

src/workerd/tests/bench-stream-piping.c++

4.4 ms4.4 ms

Existing_Large_Byte_Auto64K

src/workerd/tests/bench-stream-piping.c++

3.9 ms3.9 ms

request[RegExpBenchmark]

src/workerd/tests/bench-regex.c++

7.3 ms7.3 ms

Encode_ASCII_256[TextEncoder][0/0/256]

src/workerd/tests/bench-text-encoder.c++

3.1 ms3.1 ms

Existing_Medium_Byte

src/workerd/tests/bench-stream-piping.c++

6.7 ms6.7 ms

New_Tiny_Byte

src/workerd/tests/bench-stream-piping.c++

7.1 ms7.1 ms

Existing_Small_SlowValue

src/workerd/tests/bench-stream-piping.c++

5.6 ms5.6 ms

set_append[ApiHeaders]

src/workerd/tests/bench-api-headers.c++

11.7 ms11.7 ms

Existing_Small_Value

src/workerd/tests/bench-stream-piping.c++

5.1 ms5.1 ms

Existing_Small_Timed10us

src/workerd/tests/bench-stream-piping.c++

6.6 ms6.6 ms

New_Medium_Value

src/workerd/tests/bench-stream-piping.c++

2.8 ms2.8 ms

New_Tiny_Byte_HWM16K

src/workerd/tests/bench-stream-piping.c++

2.8 ms2.8 ms

Existing_Medium_Byte_HWM16K

src/workerd/tests/bench-stream-piping.c++

6.7 ms6.7 ms

Existing_Medium_Value

src/workerd/tests/bench-stream-piping.c++

5.7 ms5.7 ms

Existing_Large_IoLatencyByte

src/workerd/tests/bench-stream-piping.c++

14.7 ms14.7 ms

Existing_Medium_IoLatencyByte

src/workerd/tests/bench-stream-piping.c++

8.2 ms8.2 ms

Existing_Small_Byte

src/workerd/tests/bench-stream-piping.c++

6 ms6 ms

Existing_Small_IoLatencyValue

src/workerd/tests/bench-stream-piping.c++

6.6 ms6.6 ms

EncodeInto_TwoByte_1024[TextEncoder][1/2/1024]

src/workerd/tests/bench-text-encoder.c++

14.2 ms14.1 ms

Existing_Medium_IoLatencyValue

src/workerd/tests/bench-stream-piping.c++

7.2 ms7.2 ms

Existing_Large_Byte

src/workerd/tests/bench-stream-piping.c++

14.4 ms14.4 ms

New_Small_Value_HWM16K

src/workerd/tests/bench-stream-piping.c++

1.9 ms1.9 ms

request[GlobalScopeBenchmark]

src/workerd/tests/bench-global-scope.c++

52.6 ms52.6 ms

New_Large_IoLatencyByte

src/workerd/tests/bench-stream-piping.c++

7.2 ms7.2 ms

New_Large_Byte_Auto64K

src/workerd/tests/bench-stream-piping.c++

4 ms4 ms

New_Small_Byte_Auto64K

src/workerd/tests/bench-stream-piping.c++

9.2 ms9.2 ms

Existing_Medium_SlowValue

src/workerd/tests/bench-stream-piping.c++

6.2 ms6.2 ms

Existing_Tiny_Byte

src/workerd/tests/bench-stream-piping.c++

15 ms15 ms

Test_JSON_DEC

src/workerd/tests/bench-json.c++

3.2 s3.2 s

ParseAndSerialize

src/workerd/tests/bench-mimetype.c++::Mimetype

74.9 ms74.9 ms

New_Medium_Byte

src/workerd/tests/bench-stream-piping.c++

3.8 ms3.8 ms

Serialize

src/workerd/tests/bench-mimetype.c++::Mimetype

74.6 ms74.6 ms

EncodeInto_ASCII_256[TextEncoder][1/0/256]

src/workerd/tests/bench-text-encoder.c++

2.6 ms2.6 ms

New_Large_Byte_HWM16K

src/workerd/tests/bench-stream-piping.c++

6.9 ms6.9 ms

EncodeInto_OneByte_256[TextEncoder][1/1/256]

src/workerd/tests/bench-text-encoder.c++

4.5 ms4.5 ms

EncodeInto_TwoByte_256[TextEncoder][1/2/256]

src/workerd/tests/bench-text-encoder.c++

5.4 ms5.4 ms

Encode_OneByte_256[TextEncoder][0/1/256]

src/workerd/tests/bench-text-encoder.c++

5.1 ms5.1 ms

Encode_TwoByte_8192[TextEncoder][0/2/8192]

src/workerd/tests/bench-text-encoder.c++

146.1 ms146.1 ms

arrayBufferBody[Response]

src/workerd/tests/bench-response.c++

17.4 µs17.4 µs

New_Small_SlowValue

src/workerd/tests/bench-stream-piping.c++

2.5 ms2.5 ms

Encode_OneByte_8192[TextEncoder][0/1/8192]

src/workerd/tests/bench-text-encoder.c++

84.7 ms84.7 ms

Util_RecursivelyFreeze

src/workerd/tests/bench-util.c++

10.8 ms10.8 ms

bm_Immediate

external/+http+capnp-cpp/src/kj/async-bench.c++

3.6 µs3.6 µs

bm_coroCoAwaitImmediate

external/+http+capnp-cpp/src/kj/async-bench.c++

6.2 µs6.2 µs

bm_coroCoReturn

external/+http+capnp-cpp/src/kj/async-bench.c++

4.6 µs4.6 µs

bm_ReadyNow

external/+http+capnp-cpp/src/kj/async-bench.c++

2.1 µs2.1 µs

JsString_Utf8Length_Utf16_NonFlat_256

src/workerd/tests/bench-jsstring.c++

8.9 µs8.9 µs

JsString_Utf8Length_Latin1_Flat_8192

src/workerd/tests/bench-jsstring.c++

31 µs31 µs

JsString_Utf8Length_Latin1_Flat_1024

src/workerd/tests/bench-jsstring.c++

4.6 µs4.6 µs

JsString_Utf8Length_Latin1_Flat_256

src/workerd/tests/bench-jsstring.c++

1.7 µs1.7 µs

Parse[KjHeaders]

src/workerd/tests/bench-kj-headers.c++

44.3 µs44.3 µs

JsString_Utf8Length_Latin1_NonFlat_256

src/workerd/tests/bench-jsstring.c++

7.9 µs7.9 µs

JsString_Utf8Length_Utf16_NonFlat_8192

src/workerd/tests/bench-jsstring.c++

73.8 µs73.8 µs

JsString_Utf8Length_Latin1_Flat_32

src/workerd/tests/bench-jsstring.c++

920.3 ns920.3 ns

JsString_Utf8Length_Latin1_NonFlat_1024

src/workerd/tests/bench-jsstring.c++

12.1 µs12.1 µs

JsString_Utf8Length_Utf16_Flat_1024

src/workerd/tests/bench-jsstring.c++

8.6 µs8.6 µs

nullBodyWithStatus[Response]

src/workerd/tests/bench-response.c++

10.2 µs10.2 µs

simpleStringBody[Response]

src/workerd/tests/bench-response.c++

18.9 µs18.9 µs

JsString_Utf8Length_Utf16_Invalid_Flat_8192

src/workerd/tests/bench-jsstring.c++

62.9 µs62.9 µs

JsString_Utf8Length_Utf16_Flat_8192

src/workerd/tests/bench-jsstring.c++

62.9 µs62.9 µs

JsString_Utf8Length_Latin1_NonFlat_8192

src/workerd/tests/bench-jsstring.c++

42 µs42 µs

JsString_Utf8Length_Utf16_Invalid_Flat_1024

src/workerd/tests/bench-jsstring.c++

8.6 µs8.6 µs

JsString_Utf8Length_Utf16_Invalid_Flat_256

src/workerd/tests/bench-jsstring.c++

2.7 µs2.7 µs

JsString_Utf8Length_Utf16_Invalid_NonFlat_1024

src/workerd/tests/bench-jsstring.c++

16.1 µs16.1 µs

JsString_Utf8Length_Utf16_Invalid_NonFlat_256

src/workerd/tests/bench-jsstring.c++

8.9 µs8.9 µs

JsString_Utf8Length_Utf16_Flat_256

src/workerd/tests/bench-jsstring.c++

2.7 µs2.7 µs

JsString_Utf8Length_Utf16_NonFlat_1024

src/workerd/tests/bench-jsstring.c++

16.2 µs16.2 µs

JsString_Utf8Length_Utf16_Invalid_NonFlat_8192

src/workerd/tests/bench-jsstring.c++

73.8 µs73.8 µs

New_Small_Byte_Auto64K_HWM16K

src/workerd/tests/bench-stream-piping.c++

4.2 ms4.2 ms

New_Large_Value_HWM16K

src/workerd/tests/bench-stream-piping.c++

2.6 ms2.6 ms

EncodeInto_OneByte_1024[TextEncoder][1/1/1024]

src/workerd/tests/bench-text-encoder.c++

10.5 ms10.5 ms

Existing_Small_Byte_Auto64K

src/workerd/tests/bench-stream-piping.c++

12.3 ms12.3 ms

Existing_Medium_Timed100us

src/workerd/tests/bench-stream-piping.c++

7.2 ms7.2 ms

New_Tiny_Value

src/workerd/tests/bench-stream-piping.c++

4.7 ms4.7 ms

EncodeInto_ASCII_1024[TextEncoder][1/0/1024]

src/workerd/tests/bench-text-encoder.c++

2.6 ms2.6 ms

Existing_Large_Byte_Auto64K_HWM16K

src/workerd/tests/bench-stream-piping.c++

3.9 ms3.9 ms

Existing_Large_Value_HWM16K

src/workerd/tests/bench-stream-piping.c++

2.6 ms2.6 ms

EncodeInto_TwoByte_8192[TextEncoder][1/2/8192]

src/workerd/tests/bench-text-encoder.c++

96.7 ms96.7 ms

Existing_Large_IoLatencyValue

src/workerd/tests/bench-stream-piping.c++

2.9 ms2.9 ms

Test_JSON_ENC

src/workerd/tests/bench-json.c++

205.9 ms206 ms

EncodeInto_OneByte_8192[TextEncoder][1/1/8192]

src/workerd/tests/bench-text-encoder.c++

66.7 ms66.7 ms

Encode_ASCII_8192[TextEncoder][0/0/8192]

src/workerd/tests/bench-text-encoder.c++

13.1 ms13.1 ms

New_Large_Byte

src/workerd/tests/bench-stream-piping.c++

6.9 ms6.9 ms

constructor[ApiHeaders]

src/workerd/tests/bench-api-headers.c++

67.6 ms67.6 ms

New_Large_IoLatencyValue

src/workerd/tests/bench-stream-piping.c++

2.9 ms2.9 ms

Existing_Medium_Byte_Auto64K

src/workerd/tests/bench-stream-piping.c++

13 ms13 ms

Encode_ASCII_32[TextEncoder][0/0/32]

src/workerd/tests/bench-text-encoder.c++

3 ms3 ms

Existing_Small_Timed100us

src/workerd/tests/bench-stream-piping.c++

6.6 ms6.6 ms

New_Large_Byte_Auto64K_HWM16K

src/workerd/tests/bench-stream-piping.c++

4 ms4 ms

New_Small_Value

src/workerd/tests/bench-stream-piping.c++

2 ms2 ms

New_Tiny_Byte_Auto64K

src/workerd/tests/bench-stream-piping.c++

23.3 ms23.3 ms

New_Medium_IoLatencyByte

src/workerd/tests/bench-stream-piping.c++

5.4 ms5.4 ms

New_Medium_Byte_Auto64K

src/workerd/tests/bench-stream-piping.c++

10.1 ms10.1 ms

New_Small_IoLatencyByte

src/workerd/tests/bench-stream-piping.c++

4.5 ms4.5 ms

New_Tiny_Value_HWM16K

src/workerd/tests/bench-stream-piping.c++

4.7 ms4.7 ms

New_Medium_Value_HWM16K

src/workerd/tests/bench-stream-piping.c++

2.8 ms2.8 ms

Existing_Small_Byte_Auto64K_HWM16K

src/workerd/tests/bench-stream-piping.c++

1.6 ms1.6 ms

Encode_TwoByte_1024[TextEncoder][0/2/1024]

src/workerd/tests/bench-text-encoder.c++

19.5 ms19.5 ms

Existing_Tiny_Value

src/workerd/tests/bench-stream-piping.c++

12.6 ms12.6 ms

Existing_Medium_Value_HWM16K

src/workerd/tests/bench-stream-piping.c++

5.7 ms5.7 ms

Existing_Tiny_Value_HWM16K

src/workerd/tests/bench-stream-piping.c++

12.6 ms12.6 ms

Encode_OneByte_1024[TextEncoder][0/1/1024]

src/workerd/tests/bench-text-encoder.c++

11.9 ms11.9 ms

Existing_Tiny_Byte_Auto64K

src/workerd/tests/bench-stream-piping.c++

31.2 ms31.2 ms

Existing_Small_Byte_HWM16K

src/workerd/tests/bench-stream-piping.c++

1.6 ms1.6 ms

New_Medium_Byte_Auto64K_HWM16K

src/workerd/tests/bench-stream-piping.c++

8.4 ms8.4 ms

EncodeInto_ASCII_8192[TextEncoder][1/0/8192]

src/workerd/tests/bench-text-encoder.c++

3.4 ms3.4 ms

Existing_Large_Byte_HWM16K

src/workerd/tests/bench-stream-piping.c++

14.4 ms14.4 ms

New_Small_IoLatencyValue

src/workerd/tests/bench-stream-piping.c++

3.6 ms3.6 ms

Encode_ASCII_1024[TextEncoder][0/0/1024]

src/workerd/tests/bench-text-encoder.c++

3.7 ms3.7 ms

Existing_Medium_Byte_Auto64K_HWM16K

src/workerd/tests/bench-stream-piping.c++

6.3 ms6.3 ms

Existing_Small_Timed1ms

src/workerd/tests/bench-stream-piping.c++

6.6 ms6.6 ms

New_Small_Timed10us

src/workerd/tests/bench-stream-piping.c++

3.6 ms3.6 ms

New_Medium_Timed100us

src/workerd/tests/bench-stream-piping.c++

4.4 ms4.4 ms

New_Small_Byte

src/workerd/tests/bench-stream-piping.c++

2.9 ms2.9 ms

Encode_TwoByte_256[TextEncoder][0/2/256]

src/workerd/tests/bench-text-encoder.c++

7 ms7 ms

Existing_Small_Value_HWM16K

src/workerd/tests/bench-stream-piping.c++

5 ms5 ms

New_Medium_Byte_HWM16K

src/workerd/tests/bench-stream-piping.c++

3.8 ms3.8 ms

New_Small_Timed100us

src/workerd/tests/bench-stream-piping.c++

3.6 ms3.6 ms

Existing_Large_Value

src/workerd/tests/bench-stream-piping.c++

2.6 ms2.6 ms

New_Large_Value

src/workerd/tests/bench-stream-piping.c++

2.6 ms2.7 ms

Existing_Tiny_Byte_Auto64K_HWM16K

src/workerd/tests/bench-stream-piping.c++

-1%

3 ms3 ms

bodyWithHeaders[Response]

src/workerd/tests/bench-response.c++

-3%

24.2 µs24.8 µs

Commits

Click on a commit to change the comparison range

Base

main

6bacc75

-18.79%

Fix encoding canonical names to match WHATWG spec Changes both implementation and tests to use canonical encoding names: - 'ibm-866' → 'ibm866' (remove hyphen) - 'shift-jis' → 'shift_jis' (use underscore) Per WHATWG Encoding Standard, TextDecoder.encoding should return the canonical encoding name, not the label used to construct it. Fixes #5663

2977ef0

4 days ago

by woustachemax

Home Terms Privacy Docs