Uses of Interface
com.gengoai.hermes.morphology.Tokenizer
-
Packages that use Tokenizer Package Description com.gengoai.hermes.en com.gengoai.hermes.morphology -
-
Uses of Tokenizer in com.gengoai.hermes.en
Classes in com.gengoai.hermes.en that implement Tokenizer Modifier and Type Class Description class
ENTokenizer
English language tokenizer -
Uses of Tokenizer in com.gengoai.hermes.morphology
Classes in com.gengoai.hermes.morphology that implement Tokenizer Modifier and Type Class Description class
BreakIteratorTokenizer
A tokenizer implementation based on Java's BreakIterator classMethods in com.gengoai.hermes.morphology that return Tokenizer Modifier and Type Method Description static Tokenizer
Tokenizers. getTokenizer(@NonNull Language language)
Creates a tokenizer for the given language.
-