yomidevs
yomitan
Blog
Docs
Changelog
Blog
Docs
Changelog
Overview
Branches
Benchmarks
Runs
Speed up tokenization for heavy workflows
#2251
Merged
Comparing
ShanaryS:tokenize-speedup
(
af1d8e5
) with
master
(
e99a827
)
CodSpeed Performance Gauge
0%
Untouched
5
Ignored
1
Benchmarks
Mode
CPU Simulation
Wall Time
Memory
Status
Untouched
Ignored
6 total
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
japanese transformations-full (n=212)
benches/japanese-language-transformer.bench.js::japanese language transformer::basic tests
CodSpeed Performance Gauge
0%
22.4 ms
22.4 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
japanese transformations (n=78)
benches/japanese-language-transformer.bench.js::japanese language transformer::basic tests
CodSpeed Performance Gauge
0%
8.3 ms
8.3 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
spanish transformations (n=97)
benches/spanish-language-transformer.bench.js::spanish language transformer::basic tests
CodSpeed Performance Gauge
0%
6.4 ms
6.4 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
Translator.prototype.findKanji - (n=3)
benches/translator.bench.js::Translator
CodSpeed Performance Gauge
0%
3.8 ms
3.8 ms
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
Translator.prototype.findTerms - (n=45)
benches/translator.bench.js::Translator
CodSpeed Performance Gauge
0%
113.8 ms
114 ms
The benchmarks below are ignored and won't be included in regression detection.
Learn more about ignoring benchmarks
Uses the
CPU Simulation instrument
to collect CPU performance metrics.
Loop 1 through 100,000
benches/canary.bench.js::Canary
Ignored
CodSpeed Performance Gauge
0%
4.2 ms
4.2 ms
Commits
Click on a commit to change the comparison range
Base
master
e99a827
-0.02%
use LRU cache for tokenize
e93838a
3 months ago
by ShanaryS
0%
fix refactor bug
6361c03
3 months ago
by ShanaryS
+0.01%
maintain separation between parse results
ae838ff
3 months ago
by ShanaryS
-0.05%
add array index to results
af1d8e5
3 months ago
by ShanaryS
© 2026 CodSpeed Technology
Home
Terms
Privacy
Docs