Interface Summary
Lexer An interface for lexers.

Class Summary
DigitLexer Only allows single decimal digit tokens.
FormalLexer A simple lexer for programming language-like languages.
IgnoreLexer A lexer which takes the output from another lexer and removes all WORD tokens not in a given set.
Lexers Maps language names to lexers.
LexerTest Test a lexer.
RegexLexer Uses a single regular expression for lexing.
SimpleLexer A simple lexer.