| /external/antlr/antlr-3.4/runtime/ObjC/Framework/examples/lexertest-simple/output1/ |
| Testlexer.m | 6 * - for the lexer : TestLexerLexer *
56 /** As per Terence: No returns for lexer rules!
|
| /external/antlr/antlr-3.4/runtime/Python/antlr3/ |
| dfa.py | 195 15MB lexer, eating all my swap space and I was to impacient to see,
197 at import time of the lexer module, everything works like a charm.
|
| /external/antlr/antlr-3.4/runtime/Python/ |
| setup.py | 31 't[0-9]*Lexer.py', 't[0-9]*Parser.py',
227 if testPath.endswith('Lexer.py') or testPath.endswith('Parser.py'):
|
| /external/chromium_org/third_party/angle/src/ |
| compiler.gypi | 180 'compiler/preprocessor/Lexer.cpp',
181 'compiler/preprocessor/Lexer.h',
|
| /external/chromium_org/tools/idl_parser/ |
| idl_ppapi_parser.py | 281 def __init__(self, lexer, verbose=False, debug=False, mute_error=False):
282 IDLParser.__init__(self, lexer, verbose, debug, mute_error)
|
| /external/clang/include/clang/Lex/ |
| TokenLexer.h | 25 /// TokenLexer - This implements a lexer that returns tokens from a macro body
124 /// the token lexer is empty.
|
| /external/llvm/docs/tutorial/ |
| LangImpl2.rst | 13 lexer, built in `Chapter 1 <LangImpl1.html>`_, to build a full
140 (which is returned as three tokens by the lexer) into an AST that could
155 /// lexer and updates CurTok with its results.
161 This implements a simple token buffer around the lexer. This allows us
162 to look one token ahead at what the lexer is returning. Every function
201 creates a ``NumberExprAST`` node, advances the lexer to the next token,
206 production and returns the lexer buffer with the next token (which is
652 lexer, parser, and AST builder. With this done, the executable will
|
| OCamlLangImpl5.rst | 25 It basically requires adding lexer support for this "new" concept to the
26 lexer, parser, AST, and LLVM code emitter. This example is nice, because
60 Lexer Extensions for If/Then/Else
63 The lexer extensions are straightforward. First we add new variants for
71 Once we have that, we recognize the new keywords in the lexer. This is
104 Now that we have the relevant tokens coming from the lexer and we have
415 Lexer Extensions for the 'for' Loop
418 The lexer extensions are the same sort of thing as for if/then/else:
427 ... in Lexer.lex_ident...
710 <{lexer,parser}.ml>: use_camlp4, pp(camlp4of
[all...] |
| LangImpl5.rst | 26 lexer, parser, AST, and LLVM code emitter. This example is nice, because
60 Lexer Extensions for If/Then/Else
63 The lexer extensions are straightforward. First we add new enum values
71 Once we have that, we recognize the new keywords in the lexer. This is
105 Now that we have the relevant tokens coming from the lexer and we have
434 Lexer Extensions for the 'for' Loop
437 The lexer extensions are the same sort of thing as for if/then/else:
|
| /external/antlr/antlr-3.4/tool/src/test/java/org/antlr/test/ |
| TestASTConstruction.java | 61 "lexer grammar P;\n"+
148 "lexer grammar P;\n"+
168 "lexer grammar P;\n"+
188 "lexer grammar P;\n"+
208 "lexer grammar P;\n"+
218 "lexer grammar P;\n"+
|
| /external/clang/lib/Frontend/ |
| CacheTokens.cpp | 1 //===--- CacheTokens.cpp - Caching of lexer tokens for PTH support --------===//
21 #include "clang/Lex/Lexer.h"
235 PTHEntry LexTokens(Lexer& L);
291 PTHEntry PTHWriter::LexTokens(Lexer& L) {
490 // Iterate over all the files in SourceManager. Create a lexer
509 Lexer L(FID, FromFile, SM, LOpts);
|
| /prebuilts/tools/common/m2/repository/com/google/jsilver/jsilver/1.0.0/ |
| jsilver-1.0.0-sources.jar | |
| /external/antlr/antlr-3.4/runtime/C/src/ |
| antlr3baserecognizer.c | 3 * Any function can be overridden by a lexer/parser/tree parser or by the
45 * almost completely but are overridden by the parser or tree parser as needed. Lexer overrides
272 pANTLR3_LEXER lexer; local
285 lexer = NULL;
293 lexer = (pANTLR3_LEXER) (recognizer->super);
294 ins = lexer->input;
1921 pANTLR3_LEXER lexer; local
1996 pANTLR3_LEXER lexer; local
[all...] |
| /external/antlr/antlr-3.4/runtime/Ruby/test/functional/ast-output/ |
| rewrites.rb | 13 grammar_module::Lexer.send( :include, ANTLR3::Test::CollectErrors )
14 grammar_module::Lexer.send( :include, ANTLR3::Test::CaptureOutput )
18 lexer = grammar_module::Lexer.new( input )
19 parser = grammar_module::Parser.new( lexer )
41 grammar_module::Lexer.send( :include, ANTLR3::Test::CollectErrors )
42 grammar_module::Lexer.send( :include, ANTLR3::Test::CaptureOutput )
48 lexer = grammar_module::Lexer.new( input )
49 parser = grammar.module::Parser.new( lexer )
[all...] |
| /external/chromium_org/third_party/cython/src/Cython/Debugger/ |
| libcython.py | 233 filename = lineno = lexer = None
238 lexer = pygments.lexers.CythonLexer(stripall=False)
250 lexer = pygments.lexers.PythonLexer(stripall=False)
260 lexer = pygments.lexers.CLexer(stripall=False)
262 return SourceFileDescriptor(filename, lexer), lineno
405 def __init__(self, filename, lexer, formatter=None):
407 self.lexer = lexer
414 if pygments and self.lexer and parameters.colorize_code:
421 return pygments.highlight(code, self.lexer, formatter
[all...] |
| /external/antlr/antlr-3.4/runtime/Java/src/main/java/org/antlr/runtime/ |
| BaseRecognizer.java | 36 * lexer, parser, and tree grammars. This is all the parsing
51 /** State of a lexer, parser, or tree parser are collected into a state
299 /** Get number of recognition errors (lexer, parser, tree parser). Each
300 * recognizer tracks its own number. So parser and lexer each have
323 * your token objects because you don't have to go modify your lexer
664 * If you change what tokens must be created by the lexer,
723 * TODO: move to a utility class or something; weird having lexer call this
|
| /external/antlr/antlr-3.4/tool/src/main/antlr3/org/antlr/grammar/v3/ |
| ActionTranslator.g | 28 lexer grammar ActionTranslator;
285 * If in lexer grammar, only translate for strings and tokens (rule refs)
292 (grammar.type!=Grammar.LEXER ||
433 /** $tokenref in a non-lexer grammar */
435 : '$' ID {grammar.type!=Grammar.LEXER && enclosingRule!=null && isTokenRefInAlt($ID.text)}?
453 /** $lexerruleref from within the lexer */
455 : '$' ID {grammar.type==Grammar.LEXER &&
|
| /external/chromium_org/mojo/public/tools/bindings/pylib/mojom_tests/parse/ |
| parser_unittest.py | 25 import mojom.parse.lexer as lexer namespace
432 lexer.LexError,
446 lexer.LexError,
455 lexer.LexError,
462 lexer.LexError,
469 lexer.LexError,
[all...] |
| /external/owasp/sanitizer/distrib/javadoc/src-html/org/owasp/html/ |
| HtmlSanitizer.Policy.html | 133 <FONT color="green">130</FONT> HtmlLexer lexer = new HtmlLexer(html);<a name="line.130"></a>
137 <FONT color="green">134</FONT> while (lexer.hasNext()) {<a name="line.134"></a>
138 <FONT color="green">135</FONT> HtmlToken token = lexer.next();<a name="line.135"></a>
152 <FONT color="green">149</FONT> while (lexer.hasNext()<a name="line.149"></a>
153 <FONT color="green">150</FONT> && lexer.next().type != HtmlTokenType.TAGEND) {<a name="line.150"></a>
161 <FONT color="green">158</FONT> while (lexer.hasNext()) {<a name="line.158"></a>
162 <FONT color="green">159</FONT> HtmlToken tagBodyToken = lexer.next();<a name="line.159"></a>
|
| HtmlSanitizer.html | 133 <FONT color="green">130</FONT> HtmlLexer lexer = new HtmlLexer(html);<a name="line.130"></a>
137 <FONT color="green">134</FONT> while (lexer.hasNext()) {<a name="line.134"></a>
138 <FONT color="green">135</FONT> HtmlToken token = lexer.next();<a name="line.135"></a>
152 <FONT color="green">149</FONT> while (lexer.hasNext()<a name="line.149"></a>
153 <FONT color="green">150</FONT> && lexer.next().type != HtmlTokenType.TAGEND) {<a name="line.150"></a>
161 <FONT color="green">158</FONT> while (lexer.hasNext()) {<a name="line.158"></a>
162 <FONT color="green">159</FONT> HtmlToken tagBodyToken = lexer.next();<a name="line.159"></a>
|
| /external/antlr/antlr-3.4/tool/src/main/java/org/antlr/tool/ |
| CompositeGrammar.java | 76 * want to lexer. Labels of DFA/NFA transitions can be both tokens
99 /** If combined or lexer grammar, track the rules.
100 * Track lexer rules so we can warn about undefined tokens.
101 * This is combined set of lexer rules from all lexer grammars
|
| Rule.java | 135 * (if not in LEXER).
181 return Character.isUpperCase(ruleName.charAt(0)) ? Grammar.LEXER : Grammar.PARSER;
268 * token IDs to check for token IDs without corresponding lexer rules.
407 if ( grammar.type != Grammar.LEXER &&
434 if ( grammar.type != Grammar.LEXER &&
|
| /external/jsilver/src/com/google/clearsilver/jsilver/syntax/ |
| jsilver.sablecc | 23 /***** Stage 1: The Lexer
25 * The lexer breaks the inbound text stream in to a sequence of tokens.
59 /* States of the lexer. */
72 // Note, because the lexer has to read 5 characters '<?cs ' before
164 /* Tokens from the lexer that the parser doesn't care about. */
|
| /external/clang/docs/ |
| InternalsManual.rst | 524 either ``Lexer::MeasureTokenLength()`` or ``Lexer::getLocForEndOfToken()``. For
550 The Lexer and Preprocessor Library
553 The Lexer library contains several tightly-connected classes that are involved
562 preprocessor is capable of reading from: a buffer lexer (provided by the
563 :ref:`Lexer <Lexer>` class) and a buffered token stream (provided by the
572 intended to be used by the lexer/preprocess and parser libraries, but are not
583 normal tokens. Normal tokens are those returned by the lexer, annotation
598 identifier lookup was enabled when the token was lexed (e.g., the lexer wa
[all...] |
| /external/antlr/antlr-3.4/runtime/Delphi/Sources/Antlr3.Runtime/ |
| Antlr.Runtime.pas | 83 /// The Lexer tracks line/col info as well as input index so its markers are
180 /// pass the buck all the way to the lexer who can ask its input stream
186 /// <summary>A source of characters for an ANTLR lexer </summary>
199 /// LA(I). This will be used for labels in the generated lexer code.
280 /// Errors from the lexer are never passed to the parser. Either you want
582 // Lexer Specific Members
583 // LEXER FIELDS (must be in same state object to avoid casting
584 // constantly in generated code and Lexer object) :(
587 /// Token object normally returned by NextToken() after matching lexer rules.
590 /// The goal of all lexer rules/methods is to create a token object
[all...] |
