Lines Matching full:token
712 the match (called the @var{token}) is made available in the
767 token from the beginning, so matching such tokens can
782 the pattern is matched the input token is simply
802 [ \t]+$ /* ignore this token */
868 executes only one action per token. Multiple
871 example, when the following scanner scans the token
897 matches a rule, the corresponding token should be
918 size of the current token, so you must not modify @code{yyleng}
926 the current token back to the input stream, where
951 The following action will take the current token
1023 attempts to match a token, it will first refill the buffer using
1278 a single token, the floating-point number 123.456:
1395 /* return string constant token type and
1566 scanner attempts to match a token from the buffer, it will first fill
1784 token match is done as though at the beginning of a line.
1787 The macro @samp{YY_AT_BOL()} returns true if the next token
1810 @samp{char *yytext} holds the text of the current token.
1830 @samp{int yyleng} holds the length of the current token.
1872 named @samp{yylex()} to find the next input token. The routine
1873 is supposed to return the type of the next token as well
2048 to decide what token has been matched if it
2052 current token, is a bit faster than only looking ahead
2056 recognized as a newline token until they enter
2057 @emph{another} token, which often means typing in another
2570 accidentally match a valid token. A possible future @code{flex}
2716 when it has scanned a token like "auto" and then the next
2745 particularly when a token contains multiple NUL's. It's best to
2752 process because it presently requires that the (huge) token
2756 the two is at about 8K characters/token.
2787 token, the equivalent of @code{yytext}.
2791 token, the equivalent of @code{yyleng}.
3118 the next token is matched, unless the scanner was
3242 @item token too large, exceeds YYLMAX
3260 both the pushed-back text and the current token in @code{yytext}.
3266 extremely large token and needed to expand the input
3350 current (generally huge) token.
