LanguageNameSearch: do not mix different scripts in same buckets

To keep the average and maximum bucket size low, I made codepoints
< 4000 more granular and code points >= 4000 less granular. This
could be tweaked further for sure to reach more even sized buckets.

Bucket stats before:
 - 773 buckets
 - smallest has 1 entries
 - largest has 1804 entries
 - median size is 66 entries
 - average size is 45.394566623545 entries

Bucket stats after:
 - 698 buckets
 - smallest has 1 entries
 - largest has 1792 entries
 - median size is 16 entries
 - average size is 50.272206303725 entries

Change-Id: Id62d93658117564b05294c2fe36ca7c182784859
This commit is contained in:
Niklas Laxström committed 2016-08-08 16:21:52 +02:00
1 parent f73f9a8b5d
commit 55b68c329d
2 files changed
+13691 -13829

No files matched your search

+13682 -13828
View File
File diff suppressed because it is too large. Load diff