# Package opennlp.tools.cmdline.tokenizer

- Class Summary
  Class | Description
  --- | ---
  DetokenEvaluationErrorListener | A default implementation of `EvaluationMonitor` that prints to an output stream.
  DictionaryDetokenizerTool |
  SimpleTokenizerTool |
  TokenEvaluationErrorListener | A default implementation of `EvaluationMonitor` that prints to an output stream.
  TokenizerConverterTool | Tool to convert multiple data formats into native OpenNLP sentence detector training format.
  TokenizerCrossValidatorTool |
  TokenizerMEEvaluatorTool | A default `TokenSample`-centric implementation of `AbstractEvaluatorTool` that prints to an output stream.
  TokenizerMETool |
  TokenizerModelLoader | Loads a `TokenizerModel` for the command line tools.
  TokenizerTrainerTool |