本文整理汇总了Python中resources.Resources.is_frequent_adverb方法的典型用法代码示例。如果您正苦于以下问题：Python Resources.is_frequent_adverb方法的具体用法？Python Resources.is_frequent_adverb怎么用？Python Resources.is_frequent_adverb使用的例子？那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在类resources.Resources的用法示例。
在下文中一共展示了Resources.is_frequent_adverb方法的2个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于系统推荐出更棒的Python代码示例。
示例1: filter_tokens
# 需要导入模块: from resources import Resources [as 别名]
# 或者: from resources.Resources import is_frequent_adverb [as 别名]
def filter_tokens(self, tokens):
new_tok = []
for token in tokens:
word = token['token']
if self.conf.getboolean('global', 'remove_stopwords') and word in Resources.stopwords:
continue
if self.conf.getboolean('global', 'remove_punctuation') and word in Resources.punctuation:
continue
if self.conf.getboolean('global', 'filter_frequent_adverbs') and Resources.is_frequent_adverb(word, token['pos']):
continue
new_tok.append(token)
return new_tok示例2: filter_tokens
# 需要导入模块: from resources import Resources [as 别名]
# 或者: from resources.Resources import is_frequent_adverb [as 别名]
def filter_tokens(self, tokens):
new_tok = []
for token in tokens:
word = token["token"]
if self.conf.getboolean("global", "remove_stopwords") and word in Resources.stopwords:
continue
if self.conf.getboolean("global", "remove_punctuation") and word in Resources.punctuation:
continue
if self.conf.getboolean("global", "filter_frequent_adverbs") and Resources.is_frequent_adverb(
word, token["pos"]
):
continue
new_tok.append(token)
return new_tok