本文整理汇总了C#中Lucene.Net.Analysis.PerFieldAnalyzerWrapper.TokenStream方法的典型用法代码示例。如果您正苦于以下问题:C# PerFieldAnalyzerWrapper.TokenStream方法的具体用法?C# PerFieldAnalyzerWrapper.TokenStream怎么用?C# PerFieldAnalyzerWrapper.TokenStream使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在类Lucene.Net.Analysis.PerFieldAnalyzerWrapper
的用法示例。
在下文中一共展示了PerFieldAnalyzerWrapper.TokenStream方法的2个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的C#代码示例。
示例1: TestPerField
public virtual void TestPerField()
{
System.String text = "Qwerty";
PerFieldAnalyzerWrapper analyzer = new PerFieldAnalyzerWrapper(new WhitespaceAnalyzer());
analyzer.AddAnalyzer("special", new SimpleAnalyzer());
TokenStream tokenStream = analyzer.TokenStream("field", new System.IO.StringReader(text));
Token token = tokenStream.Next();
Assert.AreEqual("Qwerty", token.TermText(), "WhitespaceAnalyzer does not lowercase");
tokenStream = analyzer.TokenStream("special", new System.IO.StringReader(text));
token = tokenStream.Next();
Assert.AreEqual("qwerty", token.TermText(), "SimpleAnalyzer lowercases");
}
示例2: TestPerField
public virtual void TestPerField()
{
System.String text = "Qwerty";
PerFieldAnalyzerWrapper analyzer = new PerFieldAnalyzerWrapper(new WhitespaceAnalyzer());
analyzer.AddAnalyzer("special", new SimpleAnalyzer());
TokenStream tokenStream = analyzer.TokenStream("field", new System.IO.StringReader(text));
ITermAttribute termAtt = tokenStream.GetAttribute<ITermAttribute>();
Assert.IsTrue(tokenStream.IncrementToken());
Assert.AreEqual("Qwerty", termAtt.Term, "WhitespaceAnalyzer does not lowercase");
tokenStream = analyzer.TokenStream("special", new System.IO.StringReader(text));
termAtt = tokenStream.GetAttribute<ITermAttribute>();
Assert.IsTrue(tokenStream.IncrementToken());
Assert.AreEqual("qwerty", termAtt.Term, "SimpleAnalyzer lowercases");
}