当前位置: 首页>>代码示例>>Java>>正文


Java KStemFilter类代码示例

本文整理汇总了Java中org.apache.lucene.analysis.en.KStemFilter的典型用法代码示例。如果您正苦于以下问题:Java KStemFilter类的具体用法?Java KStemFilter怎么用?Java KStemFilter使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。


KStemFilter类属于org.apache.lucene.analysis.en包,在下文中一共展示了KStemFilter类的4个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: create

import org.apache.lucene.analysis.en.KStemFilter; //导入依赖的package包/类
@Override
public TokenStream create(TokenStream tokenStream) {
    return new KStemFilter(tokenStream);
}
 
开发者ID:justor,项目名称:elasticsearch_my,代码行数:5,代码来源:KStemTokenFilterFactory.java

示例2: create

import org.apache.lucene.analysis.en.KStemFilter; //导入依赖的package包/类
@Override
public TokenFilter create(TokenStream input) {
  return new KStemFilter(input);
}
 
开发者ID:lamsfoundation,项目名称:lams,代码行数:5,代码来源:KStemFilterFactory.java

示例3: wrapper

import org.apache.lucene.analysis.en.KStemFilter; //导入依赖的package包/类
@Override
public TokenFilter wrapper(TokenStream input) {
    return new KStemFilter(input);
}
 
开发者ID:wxingyl,项目名称:elasticsearch-analysis-benz,代码行数:5,代码来源:Config.java

示例4: getNgrams

import org.apache.lucene.analysis.en.KStemFilter; //导入依赖的package包/类
public static List<String> getNgrams(String text, int N) throws IOException {
	
	List<String> tokens = new ArrayList<String>();
	
	
	Reader reader = new StringReader(text);
	// Tokenizer
	//StandardTokenizer tokenizer = new StandardTokenizer(Version.LUCENE_46, reader);
	
	LowerCaseTokenizer tokenizer = new LowerCaseTokenizer(Version.LUCENE_46, reader);
	
	// Filters
	LowerCaseFilter lowerCaseFilter = new LowerCaseFilter(Version.LUCENE_46, tokenizer); 
	KStemFilter kStemFilter = new KStemFilter(lowerCaseFilter);
	
	CharArraySet stopwords = StopAnalyzer.ENGLISH_STOP_WORDS_SET;
	StopFilter stopFilter = new StopFilter(Version.LUCENE_46, kStemFilter, stopwords);

	TokenStream ts;
	if(N > 1) {

		PositionFilter positionFilter = new PositionFilter(stopFilter);
		
		//@SuppressWarnings("resource")
		//ShingleFilter shingleFilter = new ShingleFilter(positionFilter, N, N);
		//shingleFilter.setOutputUnigrams(false);
		
		@SuppressWarnings("resource")
		ShingleFilter shingleFilter = new ShingleFilter(positionFilter, 2, N);
		shingleFilter.setOutputUnigrams(true);
		
		ts = shingleFilter;
	}
	else {
		ts = stopFilter;
	}
	
	CharTermAttribute charTermAtt = ts.addAttribute(CharTermAttribute.class);
	
	ts.reset();
	while (ts.incrementToken()) {
		String token = charTermAtt.toString();
		if(token.length()>1)
			tokens.add(token);
      }
      ts.end();  
      ts.close();
      
	return tokens;
}
 
开发者ID:MKLab-ITI,项目名称:mgraph-summarization,代码行数:51,代码来源:TextAnalyser.java


注:本文中的org.apache.lucene.analysis.en.KStemFilter类示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。