Home | History | Annotate | Download | only in common

Lines Matching full:word

100 // Helper class for improving readability of the Thai word break
109 // list of word candidate lengths, in increasing length order
112 int32_t prefix; // The longest match with a dictionary word
131 // Return the longest prefix this candidate location shares with a dictionary word
154 // Dictionary leaves text after longest prefix, not longest word. Back up.
195 // Will not combine a non-word with a preceding dictionary word longer than this
198 // Will not combine a non-word that shares at least this much prefix with a
199 // dictionary word, with a preceding word
208 // Minimum word size
283 // Followed by another dictionary word; mark first word as a good candidate
293 // See if any of the possible second words is followed by a third word
295 // If we find a third word, stop right away
310 // We come here after having either found a word or not. We look ahead to the
311 // next word. If it's not a dictionary word, we will combine it withe the word we
312 // just found (if there is one), but only if the preceding word does not exceed
314 // The text iterator should now be positioned at the end of the word we found.
316 // if it is a dictionary word, do nothing. If it isn't, then if there is
317 // no preceding word, or the non-word shares less than the minimum threshold
318 // of characters with a dictionary word, then scan to resynchronize
322 // Look for a plausible word boundary
351 // Bump the word count if there wasn't already one
372 // Look ahead for possible suffixes if a dictionary word does not follow.
375 // could be a typo in the middle of a word.
384 wordLength += 1; // Add PAIYANNOI to word
397 wordLength += 1; // Add MAIYAMOK to word
410 // Did we find a word on this iteration? If so, push it on the break stack