Uses of Class
org.apache.lucene.analysis.TokenizerFactory
Packages that use TokenizerFactory
Package
Description
Text analysis.
Fast, general-purpose grammar-based tokenizers.
Analyzer for Simplified Chinese, which indexes words.
Basic, general-purpose analysis components.
A general-purpose Analyzer that can be created with a builder-style API.
Fast, general-purpose URLs and email addresses tokenizers.
Tokenizer that breaks text into words with the Unicode Text Segmentation algorithm.
Analyzer for Japanese.
Analyzer for Korean.
Character n-gram tokenizers and filters.
Analysis components for path-like strings such as filenames.
Set of components for pattern-based (regex) analysis.
Fast, general-purpose grammar-based tokenizer
StandardTokenizer
implements the Word Break rules from the
Unicode Text Segmentation algorithm, as specified in Unicode Standard Annex #29.Analysis components for Synonyms.
Analyzer for Thai.
Tokenizer that is aware of Wikipedia syntax.
-
Uses of TokenizerFactory in org.apache.lucene.analysis
Fields in org.apache.lucene.analysis with type parameters of type TokenizerFactoryModifier and TypeFieldDescriptionprivate static final AnalysisSPILoader
<TokenizerFactory> TokenizerFactory.Holder.LOADER
Methods in org.apache.lucene.analysis that return TokenizerFactoryModifier and TypeMethodDescriptionstatic TokenizerFactory
looks up a tokenizer by name from context classpathMethods in org.apache.lucene.analysis that return types with arguments of type TokenizerFactoryModifier and TypeMethodDescription(package private) static AnalysisSPILoader
<TokenizerFactory> TokenizerFactory.Holder.getLoader()
static Class
<? extends TokenizerFactory> TokenizerFactory.lookupClass
(String name) looks up a tokenizer class by name from context classpathMethod parameters in org.apache.lucene.analysis with type arguments of type TokenizerFactoryModifier and TypeMethodDescriptionstatic String
TokenizerFactory.findSPIName
(Class<? extends TokenizerFactory> serviceClass) looks up a SPI name for the specified tokenizer factory -
Uses of TokenizerFactory in org.apache.lucene.analysis.classic
Subclasses of TokenizerFactory in org.apache.lucene.analysis.classic -
Uses of TokenizerFactory in org.apache.lucene.analysis.cn.smart
Subclasses of TokenizerFactory in org.apache.lucene.analysis.cn.smart -
Uses of TokenizerFactory in org.apache.lucene.analysis.core
Subclasses of TokenizerFactory in org.apache.lucene.analysis.coreModifier and TypeClassDescriptionclass
Factory forKeywordTokenizer
.class
Factory forLetterTokenizer
.class
Factory forWhitespaceTokenizer
. -
Uses of TokenizerFactory in org.apache.lucene.analysis.custom
Fields in org.apache.lucene.analysis.custom declared as TokenizerFactoryFields in org.apache.lucene.analysis.custom with type parameters of type TokenizerFactoryModifier and TypeFieldDescriptionprivate final SetOnce
<TokenizerFactory> CustomAnalyzer.Builder.tokenizer
Methods in org.apache.lucene.analysis.custom that return TokenizerFactoryModifier and TypeMethodDescriptionCustomAnalyzer.getTokenizerFactory()
Returns the tokenizer that is used in this analyzer.Method parameters in org.apache.lucene.analysis.custom with type arguments of type TokenizerFactoryModifier and TypeMethodDescriptionCustomAnalyzer.Builder.withTokenizer
(Class<? extends TokenizerFactory> factory, String... params) Uses the given tokenizer.CustomAnalyzer.Builder.withTokenizer
(Class<? extends TokenizerFactory> factory, Map<String, String> params) Uses the given tokenizer.Constructors in org.apache.lucene.analysis.custom with parameters of type TokenizerFactoryModifierConstructorDescription(package private)
CustomAnalyzer
(CharFilterFactory[] charFilters, TokenizerFactory tokenizer, TokenFilterFactory[] tokenFilters, Integer posIncGap, Integer offsetGap) -
Uses of TokenizerFactory in org.apache.lucene.analysis.email
Subclasses of TokenizerFactory in org.apache.lucene.analysis.email -
Uses of TokenizerFactory in org.apache.lucene.analysis.icu.segmentation
Subclasses of TokenizerFactory in org.apache.lucene.analysis.icu.segmentation -
Uses of TokenizerFactory in org.apache.lucene.analysis.ja
Subclasses of TokenizerFactory in org.apache.lucene.analysis.ja -
Uses of TokenizerFactory in org.apache.lucene.analysis.ko
Subclasses of TokenizerFactory in org.apache.lucene.analysis.ko -
Uses of TokenizerFactory in org.apache.lucene.analysis.ngram
Subclasses of TokenizerFactory in org.apache.lucene.analysis.ngramModifier and TypeClassDescriptionclass
Creates new instances ofEdgeNGramTokenizer
.class
Factory forNGramTokenizer
. -
Uses of TokenizerFactory in org.apache.lucene.analysis.path
Subclasses of TokenizerFactory in org.apache.lucene.analysis.path -
Uses of TokenizerFactory in org.apache.lucene.analysis.pattern
Subclasses of TokenizerFactory in org.apache.lucene.analysis.patternModifier and TypeClassDescriptionclass
Factory forPatternTokenizer
.class
Factory forSimplePatternSplitTokenizer
, for producing tokens by splitting according to the provided regexp.class
Factory forSimplePatternTokenizer
, for matching tokens based on the provided regexp. -
Uses of TokenizerFactory in org.apache.lucene.analysis.standard
Subclasses of TokenizerFactory in org.apache.lucene.analysis.standard -
Uses of TokenizerFactory in org.apache.lucene.analysis.synonym
Methods in org.apache.lucene.analysis.synonym that return TokenizerFactoryModifier and TypeMethodDescriptionprivate TokenizerFactory
SynonymFilterFactory.loadTokenizerFactory
(ResourceLoader loader, String cname) Deprecated.private TokenizerFactory
SynonymGraphFilterFactory.loadTokenizerFactory
(ResourceLoader loader, String cname) -
Uses of TokenizerFactory in org.apache.lucene.analysis.th
Subclasses of TokenizerFactory in org.apache.lucene.analysis.th -
Uses of TokenizerFactory in org.apache.lucene.analysis.wikipedia
Subclasses of TokenizerFactory in org.apache.lucene.analysis.wikipedia