Lines Matching full:token
180 * data/lalr1.cc (yytranslate_): Rename token as t to avoid clashes
181 with the member "token".
912 Warn about dubious constructions like "%token T T".
1574 * src/parse-gram.y (%require): New token, new rule.
1656 Move the token type and YYSTYPE in the parser class.
1658 (parser::token): New, from the moved free definition of tokens.
1988 * tests/regression.at (Token definitions): Don't rely on
2126 * src/scan-gram.l (<SC_PRE_CODE>.): Don't double-quote token names,
2127 now that token names are already quoted.
2155 * tests/regression.at (Token definitions, Web2c Actions):
2667 since we no longer output the message "discarding lookahead token
2755 * tests/regression.at (Token definitions, Web2c Actions): Likewise.
2775 * tests/regression.at (Token definitions): Check for backslashes
2776 in token strings.
2805 * tests/regression.at (Token definitions): Don't use a token named
3410 (yyrecoverSyntaxError): Use it when shifting the error token to
3587 Every time a token is popped, update yyerror_range[0], to have an
3588 accurate location for the error token.
3614 including for the error token.
3694 Use it consistently instead of token/nterm debugging output by
4177 Add support for hex token numbers. Suggested by Odd Arild Olsen in
4182 * doc/bison.texinfo (Token Decl): Add hexadecimal token numbers.
4207 token which are discarded.
4209 error_start_ when erroneous token are discarded.
4211 token so that it covers all the discarded tokens.
4228 * data/glr.c (yytokenName): Bullet-proof against YYEMPTY token.
4229 (yyreportSyntaxError): Handle case where lookahead token is
4289 * src/parse-gram.h (PERCENT_NO_DEFAULT_PREC): New token.
4291 * src/scan-gram.l: New token %no-default-prec.
4307 * src/parse-gram.y (PERCENT_DEFAULT_PREC): New token.
4309 * src/scan-gram.l (%default-prec): New token.
4873 Do not insert the expected token via unput, as this runs afoul
4876 since we no longer insert the expected token via unput.
5390 ([^@\n]): Renamed from [^@\n]+ so that the token buffer does not
5475 (yyerrlab): Set it. When discarding a token, push its location
5488 discarded, not just the last token.
5591 (token_type): New local var, to keep track of which token type
5595 <INITIAL>"%union"): Set token type and BEGIN SC_PRE_CODE
5596 instead of returning a token type immediately.
5597 (<INITIAL>"{"): Set token type.
5961 (%token COLON): Remove.
5962 (%token ID_COLON): New token.
5984 (unexpected_end_of_file): Now accepts start boundary of token or
6002 Return correct token start.
6076 a token; this is more compatible with byacc.
6112 Test the position of the ';' token too.
6118 parser does not discard the lookahead token if the user code
6624 counted in the token inserted at end of file. Now takes
6640 * src/parse-gram.y (CHARACTER): Remove unused token.
6651 Avoid unbounded token sizes where this is easy.
6882 * src/output.c (prepare_symbols): When printing token names,
7142 Add the "," token.
7436 Output token definitions before the first part of user declarations.
7762 token type.
8086 expected token.
8090 error message, do not report the parser accepts the error token in
8285 * tests/regression.at (Invalid inputs, Mixing %token styles):
8705 * src/lex.h (tok_dprec, tok_merge): New token types.
8754 user token numbers.
8787 * data/bison.simple (yysymprint): Don't print the token number,
8803 * src/parse-gram.y (PERCENT_PRINTER): New token.
8951 * src/parse-gram.y: Move %token in the declaration section so that
9186 Implement `%nterm', `%token' support.
9187 Merge `%term' into `%token'.
9230 * tests/calc.at: Do not use `%token "foo"' as it makes not sense
9239 (AT_DATA_HORIZONTAL_GRAMMAR): Respect the `%token ID NUM STRING'
9246 stricter %token grammar.
9255 (Token definitions): The new grammar doesn't allow too many
9307 * data/bison.simple: Output the token definition before the user's
9310 (Mixing %token styles): Check the output from bison.
9311 (Early token definitions): New.
9316 assigning twice the same user number to a token, so that we can
9333 `%token's job, and creates useless e-mail traffic with people who
9335 duplicates `%token's job.
9484 do not reduce further before shifting the error token.
9510 * tests/regression.at (Token definitions): Prototype yylex and
9615 `#define 'a'' when fed with `%token 'a' "a"'.
9616 * tests/regression.at (Token definitions): New.
9815 * data/bison.simple (yyr1): Its type is that of a token number.
9822 value for the error token, i.e., it will be assigned another
9873 Add an invocation exercising the error token.
9883 * src/reader.c (reader): Don't specify the user token number (2)
9891 undeftoken remains being 2, it is its user token number which
10141 lacking `+ 1' to nrules, Bison reported as useless a token if it
10174 (Rpcalc Lexer, Symbols, Token Decl): Don't assume ASCII.
10230 `token-name, token-number' instead of the #define.
10909 Don't store the token defs in a muscle, just be ready to output it
11159 (parse_token_decl): If the token being defined has value `0', it
11165 * src/print.c (print_grammar): Don't special case the eof token.
11553 token strings.
11594 traces do: shifting the token EOF. Before EOF was treated as a
12518 no longer put additional quotes around token names.
12795 * tests/calc.at (_AT_DATA_CALC_Y): Declare a token for EOF.
12802 * tests/regression.at (Mixing %token styles): New test.
13141 * src/reader.c (parse_token_decl): Initialize token with tok_eof.
13528 * src/lex.h (token_t): New token `tok_skel'.
13598 (packsymbols): Output token defintions to a macro.
14034 instead of returning a token.
14838 On syntax errors, report the token on which we choked.
15274 Fix token numbering (used to start at 258, not 257).
15595 New #define for adding aliases to %token.
15607 (parse_token_decl): Extended the %token
15653 always contain the token. This includes growing the token
