Class UAXURLEmailTokenizerDescriptor

  • All Implemented Interfaces:
    TokenizerDescriptor

    public class UAXURLEmailTokenizerDescriptor
    extends Object
    implements TokenizerDescriptor
    Tokenizer is like the standard tokenizer except that it recognises URLs and email addresses as single tokens.
    Since:
    7.0
    • Constructor Detail

      • UAXURLEmailTokenizerDescriptor

        public UAXURLEmailTokenizerDescriptor()