Lines Matching defs:Token
1 /* Generated By:JavaCC: Do not edit this line. Token.java Version 3.0 */
20 * Describes the input token stream.
23 public class Token {
26 * An integer that describes the kind of this token. This numbering
34 * of this token; endLine and endColumn describe the position of the
35 * last character of this token.
40 * The string image of the token.
45 * A reference to the next regular (non-special) token from the input
46 * stream. If this is the last token from the input stream, or if the
47 * token manager has not read tokens beyond this one, this field is
48 * set to null. This is true only if this token is also a regular
49 * token. Otherwise, see below for a description of the contents of
52 public Token next;
56 * token, but after the immediately preceding regular (non-special) token.
58 * When there are more than one such special token, this field refers
60 * previous special token through its specialToken field, and so on
61 * until the first special token (whose specialToken field is null).
63 * immediately follow it (without an intervening regular token). If there
64 * is no such token, this field is null.
66 public Token specialToken;
77 * Returns a new Token object, by default. However, if you want, you
80 * For example, if you have a subclass of Token called IDToken that
88 public static final Token newToken(int ofKind)
92 default : return new Token();
