marmot.tokenize

Interfaces

• Tokenizer

Classes

• AbstractTokenizer
• RuleBasedTokenizer