Lines Matching full:lexer
13 lexer, built in `Chapter 1 <LangImpl1.html>`_, to build a full
140 (which is returned as three tokens by the lexer) into an AST that could
155 /// lexer and updates CurTok with its results.
161 This implements a simple token buffer around the lexer. This allows us
162 to look one token ahead at what the lexer is returning. Every function
201 creates a ``NumberExprAST`` node, advances the lexer to the next token,
206 production and returns the lexer buffer with the next token (which is
652 lexer, parser, and AST builder. With this done, the executable will
703 // Lexer
706 // The lexer returns tokens [0-255] if it is an unknown character, otherwise one
839 /// lexer and updates CurTok with its results.
