Lines Matching refs:Token
1 /* Generated By:JavaCC: Do not edit this line. Token.java Version 6.1 */
18 * Describes the input token stream.
21 public class Token implements java.io.Serializable {
31 * An integer that describes the kind of this token. This numbering
37 /** The line number of the first character of this Token. */
39 /** The column number of the first character of this Token. */
41 /** The line number of the last character of this Token. */
43 /** The column number of the last character of this Token. */
47 * The string image of the token.
52 * A reference to the next regular (non-special) token from the input
53 * stream. If this is the last token from the input stream, or if the
54 * token manager has not read tokens beyond this one, this field is
55 * set to null. This is true only if this token is also a regular
56 * token. Otherwise, see below for a description of the contents of
59 public Token next;
63 * token, but after the immediately preceding regular (non-special) token.
65 * When there are more than one such special token, this field refers
67 * previous special token through its specialToken field, and so on
68 * until the first special token (whose specialToken field is null).
70 * immediately follow it (without an intervening regular token). If there
71 * is no such token, this field is null.
73 public Token specialToken;
76 * An optional attribute value of the Token.
80 * Any subclass of Token that actually wants to return a non-null value can
90 public Token() {}
93 * Constructs a new token for the specified Image.
95 public Token(int kind)
101 * Constructs a new token for the specified Image and Kind.
103 public Token(int kind, String image)
118 * Returns a new Token object, by default. However, if you want, you
121 * For example, if you have a subclass of Token called IDToken that
129 public static Token newToken(int ofKind, String image)
133 default : return new Token(ofKind, image);
137 public static Token newToken(int ofKind)
