Uses of Interface
com.gengoai.parsing.TokenStream
-
Packages that use TokenStream Package Description com.gengoai.parsing -
-
Uses of TokenStream in com.gengoai.parsing
Classes in com.gengoai.parsing that implement TokenStream Modifier and Type Class Description class
AbstractTokenStream
Abstract base token stream providing extracted tokens from aLexer
.class
Parser
An implementation of a Pratt Parser inspired by Pratt Parsers: Expression Parsing Made Easy.Methods in com.gengoai.parsing that return TokenStream Modifier and Type Method Description default TokenStream
Lexer. lex(Resource resource)
Reads from the given resource and tokenizes it into tokensTokenStream
Lexer. lex(String input)
Tokenizes the input string into tokensConstructors in com.gengoai.parsing with parameters of type TokenStream Constructor Description Parser(Grammar grammar, TokenStream tokenStream)
Instantiates a new Parser.
-