Lines Matching full:lexer
38 * A lexer is recognizer that draws input symbols from a character stream.
39 * lexer grammars result in a subclass of this object. A Lexer object
44 public abstract class Lexer : BaseRecognizer, ITokenSource
46 /** <summary>Where is the lexer drawing characters from?</summary> */
49 public Lexer()
53 public Lexer( ICharStream input )
58 public Lexer( ICharStream input, RecognizerSharedState state )
109 // wack Lexer state variables
177 * Instruct the lexer to skip creating a token for current lexer rule
179 * a lexer rule finishes with token set to SKIP_TOKEN. Recall that
189 /** <summary>This is the lexer entry point that sets instance var 'token'</summary> */
198 /** <summary>Set the char stream and reset the lexer</summary> */
287 Recover( mte ); // don't really recover; just consume in lexer
322 /** TODO: not thought about recovery in lexer yet.
