本文整理汇总了Java中org.apache.lucene.analysis.position.PositionFilter类的典型用法代码示例。如果您正苦于以下问题：Java PositionFilter类的具体用法？Java PositionFilter怎么用？Java PositionFilter使用的例子？那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。
PositionFilter类属于org.apache.lucene.analysis.position包，在下文中一共展示了PositionFilter类的2个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于系统推荐出更棒的Java代码示例。
示例1: create
import org.apache.lucene.analysis.position.PositionFilter; //导入依赖的package包/类
@Override
public PositionFilter create(TokenStream input) {
return new PositionFilter(input, positionIncrement);
}
示例2: getNgrams
import org.apache.lucene.analysis.position.PositionFilter; //导入依赖的package包/类
public static List<String> getNgrams(String text, int N) throws IOException {
List<String> tokens = new ArrayList<String>();
Reader reader = new StringReader(text);
// Tokenizer
//StandardTokenizer tokenizer = new StandardTokenizer(Version.LUCENE_46, reader);
LowerCaseTokenizer tokenizer = new LowerCaseTokenizer(Version.LUCENE_46, reader);
// Filters
LowerCaseFilter lowerCaseFilter = new LowerCaseFilter(Version.LUCENE_46, tokenizer);
KStemFilter kStemFilter = new KStemFilter(lowerCaseFilter);
CharArraySet stopwords = StopAnalyzer.ENGLISH_STOP_WORDS_SET;
StopFilter stopFilter = new StopFilter(Version.LUCENE_46, kStemFilter, stopwords);
TokenStream ts;
if(N > 1) {
PositionFilter positionFilter = new PositionFilter(stopFilter);
//@SuppressWarnings("resource")
//ShingleFilter shingleFilter = new ShingleFilter(positionFilter, N, N);
//shingleFilter.setOutputUnigrams(false);
@SuppressWarnings("resource")
ShingleFilter shingleFilter = new ShingleFilter(positionFilter, 2, N);
shingleFilter.setOutputUnigrams(true);
ts = shingleFilter;
}
else {
ts = stopFilter;
}
CharTermAttribute charTermAtt = ts.addAttribute(CharTermAttribute.class);
ts.reset();
while (ts.incrementToken()) {
String token = charTermAtt.toString();
if(token.length()>1)
tokens.add(token);
}
ts.end();
ts.close();
return tokens;
}