html,body{overflow:auto;} #body-content{position:relative; top:0;} #doc-content{overflow:visible;border-left:3px solid #666;} #side-nav{padding:0;} #side-nav .toggle-list ul {display:block;} #resize-packages-nav{border-bottom:3px solid #666;}

Package Index | Class Index

Classes
- GenericCharacterTokenizer
- TestGenericCharacterTokenizer

Summary: Inherited Fields | Ctors | Protected Methods | Inherited Methods | [Expand All]

public class

GenericCharacterTokenizer

extends CharTokenizer

java.lang.Object
↳	org.apache.lucene.util.AttributeSource
	↳	org.apache.lucene.analysis.TokenStream
		↳	org.apache.lucene.analysis.Tokenizer
			↳	org.apache.lucene.analysis.CharTokenizer
				↳	com.atlassian.confluence.search.lucene.tokenizers.GenericCharacterTokenizer

Class Overview

Character tokenizers that tokenizes on a specified list of delimiters.

Summary

Inherited Fields

From class org.apache.lucene.analysis.Tokenizer

Public Constructors
	GenericCharacterTokenizer(Reader input, char[] delimiters)

Protected Methods
boolean	isTokenChar(char c)

Inherited Methods

From class org.apache.lucene.analysis.CharTokenizer

From class org.apache.lucene.analysis.Tokenizer

From class org.apache.lucene.analysis.TokenStream

From class org.apache.lucene.util.AttributeSource

From class java.lang.Object

Public Constructors

public GenericCharacterTokenizer (Reader input, char[] delimiters)

Parameters

input	what to tokenize passed in as a reader
delimiters	array of delimiters to tokenize on (you must specify at least one delimiter)

Throws

IllegalArgumentException	if no delimiters are specified

Protected Methods

protected boolean isTokenChar (char c)