JSchoreels:feature/mecab-tokenizer-improvements - Branch - yomidevs/yomitan

Feature/mecab [/tokenize] support for mecab

#2254

Comparing

JSchoreels:feature/mecab-tokenizer-improvements

(

fa181fe

) with

master

(

78c15bd

)

Untouched: 5

Ignored: 1

Benchmarks

Passed

Translator.prototype.findKanji - (n=3)

benches/translator.bench.js::Translator

3.8 ms3.8 ms

Translator.prototype.findTerms - (n=45)

benches/translator.bench.js::Translator

114 ms114 ms

spanish transformations (n=97)

benches/spanish-language-transformer.bench.js::spanish language transformer::basic tests

6.4 ms6.4 ms

japanese transformations (n=78)

benches/japanese-language-transformer.bench.js::japanese language transformer::basic tests

8.3 ms8.3 ms

japanese transformations-full (n=212)

benches/japanese-language-transformer.bench.js::japanese language transformer::basic tests

22.4 ms22.4 ms

Ignored

Loop 1 through 100,000

benches/canary.bench.js::Canary

Ignored

4.2 ms4.2 ms

Commits

Click on a commit to change the comparison range

Base

master

78c15bd

-0.02%

Improve code structure to handle ipadic/unidic translated

d56f1cc

1 month ago

by JSchoreels

+0.04%

Improves edge cases

fa181fe

26 days ago

by JSchoreels

Home Terms Privacy Docs