Lines Matching full:token
605 match (called the token) is made available in the global
668 resize yytext it also must rescan the entire token from the
682 tern is matched the input token is simply discarded. For
698 [ \t]+$ /* ignore this token */
771 cutes only one action per token. Multiple REJECT's are
774 scanner scans the token "abcd", it will write "abcdab-
811 matches a rule, the corresponding token should be
829 current token, so you must not modify yyleng if you are
835 current token back to the input stream, where they will
871 following action will take the current token and cause
952 token, it will first refill the buffer using YY_INPUT
1237 token, the floating-point number 123.456:
1370 /* return string constant token type and
1560 time the scanner attempts to match a token from the buffer,
1808 the current buffer's scanning context for the next token
1812 The macro YY_AT_BOL() returns true if the next token scanned
1831 - char *yytext holds the text of the current token. It
1863 - int yyleng holds the length of the current token.
1895 named yylex() to find the next input token. The routine is
1896 supposed to return the type of the next token as well as
2078 decide what token has been matched if it absolutely
2081 enough text to disambiguate the current token, is a bit
2085 line, it is not recognized as a newline token until
2086 they enter another token, which often means typing in
2675 valid token. A possible future flex feature will be to
2827 scanned a token like "auto" and then the next character is
2867 when a token contains multiple NUL's. It's best to write
2874 because it presently requires that the (huge) token be res-
2878 at about 8K characters/token.
2920 returns the text of the most recently matched token,
2924 returns the length of the most recently matched token,
3280 next token is matched, unless the scanner was built
3408 token too large, exceeds YYLMAX - your scanner uses %array
3423 both the pushed-back text and the current token in yytext.
3442 extremely large token and needed to expand the input buffer.
3527 erally huge) token.
