本文整理汇总了Java中org.apache.lucene.analysis.ja.tokenattributes.BaseFormAttribute类的典型用法代码示例。如果您正苦于以下问题：Java BaseFormAttribute类的具体用法？Java BaseFormAttribute怎么用？Java BaseFormAttribute使用的例子？那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。
BaseFormAttribute类属于org.apache.lucene.analysis.ja.tokenattributes包，在下文中一共展示了BaseFormAttribute类的3个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于系统推荐出更棒的Java代码示例。
示例1: addAttributes
import org.apache.lucene.analysis.ja.tokenattributes.BaseFormAttribute; //导入依赖的package包/类
private void addAttributes(TokenStream tokenStream) {
tokenStream.addAttribute(OffsetAttribute.class);
tokenStream.addAttribute(ReadingAttribute.class);
tokenStream.addAttribute(PartOfSpeechAttribute.class);
tokenStream.addAttribute(InflectionAttribute.class);
tokenStream.addAttribute(BaseFormAttribute.class);
}
示例2: readBaseForm
import org.apache.lucene.analysis.ja.tokenattributes.BaseFormAttribute; //导入依赖的package包/类
private void readBaseForm(TokenStream tokenStream, LuceneToken token) {
BaseFormAttribute baseForm = tokenStream
.getAttribute(BaseFormAttribute.class);
if (baseForm != null) {
token.setBaseForm(baseForm.getBaseForm());
}
}
示例3: segmentWords
import org.apache.lucene.analysis.ja.tokenattributes.BaseFormAttribute; //导入依赖的package包/类
@Override
public List<String> segmentWords(String text) {
List<String> ret = new ArrayList<String>();
StringReader textreader = new StringReader(text);
JapaneseTokenizer segmenter =
new JapaneseTokenizer(textreader, null, true, JapaneseTokenizer.Mode.SEARCH);
JaStemmer.lemma.clear();
CharTermAttribute termAtt = segmenter.getAttribute(CharTermAttribute.class);
BaseFormAttribute baseAtt = segmenter.getAttribute(BaseFormAttribute.class);
try {
segmenter.reset();
while (segmenter.incrementToken()){
//segmenter.clearAttributes();
ret.add(termAtt.toString());
if(baseAtt.getBaseForm()!=null)
JaStemmer.lemma.put(termAtt.toString(), baseAtt.getBaseForm());
}
segmenter.close();
} catch (IOException e) {
// TODO Auto-generated catch block.
e.printStackTrace();
}
return ret;
}