Lines Matching refs:tokens
63 /** Whoever is providing tokens, needs to provide a string factory too
67 /** A special pre-allocated token, which signifies End Of Tokens. Because this must
88 * name from whence the tokens were produced by the lexer. This pointer is a
125 * i<0 indicates tokens in the past. So -1 is previous token and -2 is
126 * two tokens ago. LT(0) is undefined. For i>=n, return Token.EOFToken.
134 * If you don't want to buffer up tokens, then this method makes no
141 /** Where is this stream pulling tokens from? This is not the name, but
153 /** Return the text of all the tokens in the stream, as the old tramp in
158 /** Return the text of all tokens from start to stop, inclusive.
159 * If the stream does not buffer all the tokens then it can just
211 pANTLR3_VECTOR tokens;
213 /** Override map of tokens. If a token type has an entry in here, then
230 /** If this flag is set to ANTLR3_TRUE, then tokens that the stream sees that are not
232 * tokens table. When set to false, ALL tokens are added to the tracking.
236 /** The index into the tokens list of the current token (the next one that will be
242 * to force all tokens of type ttype to be on channel. For example,
255 /** Signal to discard off channel tokens from here on in.
259 /** Function that returns a pointer to the ANTLR3_LIST of all tokens
264 /** Function that returns all the tokens between a start and a stop index.
269 /** Function that returns all the tokens indicated by the specified bitset, within a range of tokens
274 /** Function that returns all the tokens indicated by being a member of the supplied List
279 /** Function that returns all tokens of a certain type within a range.
