Lines Matching defs:Tokenizer
34 * You must provide a {@link Tokenizer} to distinguish the
60 private Tokenizer mTokenizer;
77 * Sets the Tokenizer that will be used to determine the relevant
80 public void setTokenizer(Tokenizer t) {
87 * {@link Tokenizer#findTokenStart} to {@link #getSelectionEnd}
111 * {@link Tokenizer#findTokenStart} to {@link #getSelectionEnd}
175 * {@link Tokenizer#findTokenStart} to {@link #getSelectionEnd} by the
177 * {@link Tokenizer#terminateToken}.
212 public static interface Tokenizer {
233 * This simple Tokenizer can be used for lists where the items are
236 public static class CommaTokenizer implements Tokenizer {
