Package com.atlassian.confluence.impl.search.v2.lucene.analysis.tokenizer

Class GenericCharacterTokenizer

  • All Implemented Interfaces:
    Closeable, AutoCloseable
    public class GenericCharacterTokenizer
extends org.apache.lucene.analysis.util.CharTokenizer
    Character tokenizers that tokenizes on a specified list of delimiters.

    • Nested Class Summary

      • Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource

        org.apache.lucene.util.AttributeSource.AttributeFactory, org.apache.lucene.util.AttributeSource.State

    • Field Summary

      • Fields inherited from class org.apache.lucene.analysis.Tokenizer

        input

    • Method Summary

      All Methods Instance Methods Concrete Methods 
      Modifier and Type Method Description
      boolean equals​(Object o)  
      int hashCode()  
      protected boolean isTokenChar​(int c)  

      • Methods inherited from class org.apache.lucene.analysis.util.CharTokenizer

        end, incrementToken, normalize, reset

      • Methods inherited from class org.apache.lucene.analysis.Tokenizer

        close, correctOffset, setReader

      • Methods inherited from class org.apache.lucene.util.AttributeSource

        addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, reflectAsString, reflectWith, restoreState

    • Constructor Detail

      • GenericCharacterTokenizer

        public GenericCharacterTokenizer​(Reader input,
                                 char[] delimiters)
        Parameters:
        input - what to tokenize passed in as a reader
        delimiters - array of delimiters to tokenize on (you must specify at least one delimiter)
        Throws:
        IllegalArgumentException - if no delimiters are specified

    • Method Detail

      • isTokenChar

        protected boolean isTokenChar​(int c)
        Specified by:
        isTokenChar in class org.apache.lucene.analysis.util.CharTokenizer

      • equals

        public boolean equals​(Object o)
        Overrides:
        equals in class org.apache.lucene.util.AttributeSource

      • hashCode

        public int hashCode()
        Overrides:
        hashCode in class org.apache.lucene.util.AttributeSource