Avatar for the facet-rs user
facet-rs
facet
Instrumentation
Wall Time
BlogDocsChangelog

Remove copying of whole buffer from tokenizer

#710Merged
Comparing
look-into-tokenizer
(
e577184
) with
main
(
3a8f3a3
)
CodSpeed Performance Gauge
×3.7
Improvements
3
Regressions
0
Untouched
29
New
0
Dropped
0
Ignored
4

Benchmarks

Improved

Deserialize - Long String (100KB) - facet_json
facet-bench/benches/json.rs::Deserialize - Long String (100KB) - facet_json
CodSpeed Performance Gauge
×3.7
1,155.3 µs
312.9 µs
Deserialize - Long String (10KB) - facet_json
facet-bench/benches/json.rs::Deserialize - Long String (10KB) - facet_json
CodSpeed Performance Gauge
×2.7
122.8 µs
45.1 µs
Deserialize - Nested (depth=15) - facet_json
facet-bench/benches/json.rs::Deserialize - Nested (depth=15) - facet_json
CodSpeed Performance Gauge
+12%
5.5 ms
4.9 ms

Passed

Deserialize - Wide - facet_json
facet-bench/benches/json.rs::Deserialize - Wide - facet_json
CodSpeed Performance Gauge
+4%
88.9 µs
85.4 µs
Deserialize - canada.json - facet_json
facet-bench/benches/canada.rs::Deserialize - canada.json - facet_json
CodSpeed Performance Gauge
+1%
140.1 ms
138.5 ms
Serialize - Wide - facet_json
facet-bench/benches/json.rs::Serialize - Wide - facet_json
CodSpeed Performance Gauge
0%
54.7 µs
54.4 µs
Enum (Unit) - facet-pretty
facet-pretty/benches/compare_derive_more.rs::Enum (Unit) - facet-pretty
CodSpeed Performance Gauge
0%
7 µs
6.9 µs
Nested Struct - derive(Debug) + pretty {:#?}
facet-pretty/benches/compare_derive_more.rs::Nested Struct - derive(Debug) + pretty {:#?}
CodSpeed Performance Gauge
0%
10.5 µs
10.5 µs
Serialize - Long String (10KB) - facet_json
facet-bench/benches/json.rs::Serialize - Long String (10KB) - facet_json
CodSpeed Performance Gauge
0%
48.7 µs
48.6 µs
Complex Struct - facet-pretty
facet-pretty/benches/compare_derive_more.rs::Complex Struct - facet-pretty
CodSpeed Performance Gauge
0%
42.3 µs
42.3 µs
Wide - facet_deserialize
facet-toml/benches/compare_serde.rs::Wide - facet_deserialize
CodSpeed Performance Gauge
0%
258.1 µs
258 µs
Wide - facet_serialize
facet-toml/benches/compare_serde.rs::Wide - facet_serialize
CodSpeed Performance Gauge
0%
167.6 µs
167.5 µs
Serialize - Long String (100KB) - facet_json
facet-bench/benches/json.rs::Serialize - Long String (100KB) - facet_json
CodSpeed Performance Gauge
0%
353.3 µs
353.1 µs
Wide - serde_deserialize
facet-toml/benches/compare_serde.rs::Wide - serde_deserialize
CodSpeed Performance Gauge
0%
191 µs
190.9 µs
Serialize - Long String (10KB) - serde
facet-bench/benches/json.rs::Serialize - Long String (10KB) - serde
CodSpeed Performance Gauge
0%
50.8 µs
50.8 µs
Deserialize - Long String (100KB) - serde
facet-bench/benches/json.rs::Deserialize - Long String (100KB) - serde
CodSpeed Performance Gauge
0%
254.4 µs
254.4 µs
Serialize - canada.json - serde
facet-bench/benches/canada.rs::Serialize - canada.json - serde
CodSpeed Performance Gauge
0%
17.3 ms
17.3 ms
Serialize - canada.json - facet_json
facet-bench/benches/canada.rs::Serialize - canada.json - facet_json
CodSpeed Performance Gauge
0%
88.7 ms
88.7 ms
Deserialize - canada.json - serde
facet-bench/benches/canada.rs::Deserialize - canada.json - serde
CodSpeed Performance Gauge
0%
37.3 ms
37.3 ms
Deserialize - Long String (10KB) - serde
facet-bench/benches/json.rs::Deserialize - Long String (10KB) - serde
CodSpeed Performance Gauge
0%
29.6 µs
29.6 µs
Complex Struct - derive(Debug) + pretty {:#?}
facet-pretty/benches/compare_derive_more.rs::Complex Struct - derive(Debug) + pretty {:#?}
CodSpeed Performance Gauge
0%
20.2 µs
20.2 µs
Enum (Struct) - derive(Debug) + pretty {:#?}
facet-pretty/benches/compare_derive_more.rs::Enum (Struct) - derive(Debug) + pretty {:#?}
CodSpeed Performance Gauge
0%
7 µs
7 µs
Enum (Unit) - derive(Debug) + pretty {:#?}
facet-pretty/benches/compare_derive_more.rs::Enum (Unit) - derive(Debug) + pretty {:#?}
CodSpeed Performance Gauge
0%
2.5 µs
2.5 µs
Simple Struct - derive(Debug) + pretty {:#?}
facet-pretty/benches/compare_derive_more.rs::Simple Struct - derive(Debug) + pretty {:#?}
CodSpeed Performance Gauge
0%
7.1 µs
7.1 µs
Serialize - Long String (100KB) - serde
facet-bench/benches/json.rs::Serialize - Long String (100KB) - serde
CodSpeed Performance Gauge
0%
460.9 µs
460.9 µs
Nested Struct - facet-pretty
facet-pretty/benches/compare_derive_more.rs::Nested Struct - facet-pretty
CodSpeed Performance Gauge
0%
21.8 µs
21.8 µs
Wide - serde_serialize
facet-toml/benches/compare_serde.rs::Wide - serde_serialize
CodSpeed Performance Gauge
0%
137.6 µs
137.8 µs
Enum (Struct) - facet-pretty
facet-pretty/benches/compare_derive_more.rs::Enum (Struct) - facet-pretty
CodSpeed Performance Gauge
0%
16.1 µs
16.1 µs
Enum (Tuple) - facet-pretty
facet-pretty/benches/compare_derive_more.rs::Enum (Tuple) - facet-pretty
CodSpeed Performance Gauge
0%
15.6 µs
15.6 µs
Simple Struct - facet-pretty
facet-pretty/benches/compare_derive_more.rs::Simple Struct - facet-pretty
CodSpeed Performance Gauge
0%
14.8 µs
14.8 µs
Enum (Tuple) - derive(Debug) + pretty {:#?}
facet-pretty/benches/compare_derive_more.rs::Enum (Tuple) - derive(Debug) + pretty {:#?}
CodSpeed Performance Gauge
0%
6.1 µs
6.1 µs
Serialize - Nested (depth=15) - facet_json
facet-bench/benches/json.rs::Serialize - Nested (depth=15) - facet_json
CodSpeed Performance Gauge
-1%
3.3 ms
3.3 ms

Ignored

Deserialize - Nested (depth=15) - serdeIgnored
facet-bench/benches/json.rs::Deserialize - Nested (depth=15) - serde
CodSpeed Performance Gauge
0%
1.2 ms
1.2 ms
Deserialize - Wide - serdeIgnored
facet-bench/benches/json.rs::Deserialize - Wide - serde
CodSpeed Performance Gauge
0%
28.8 µs
28.8 µs
Serialize - Nested (depth=15) - serdeIgnored
facet-bench/benches/json.rs::Serialize - Nested (depth=15) - serde
CodSpeed Performance Gauge
+6%
547.3 µs
514.8 µs
Serialize - Wide - serdeIgnored
facet-bench/benches/json.rs::Serialize - Wide - serde
CodSpeed Performance Gauge
0%
13.4 µs
13.3 µs

Commits

Click on a commit to change the comparison range
Base
main
3a8f3a3
+1%
remove copying of whole buffer from tokenizer
f0f7613
2 days ago
by ThouCheese
+96%
apply a windowed approach to the tokenizer
640d63b
2 days ago
by ThouCheese
+47%
expand flamegraph using inline never
ad02b3f
2 days ago
by ThouCheese
+125%
cow tokens
4002998
1 day ago
by ThouCheese
0%
add tokenizer test, fix tokenizer using said test
e577184
1 day ago
by ThouCheese
© 2025 CodSpeed Technology
Home Terms PrivacyDocs