本文整理汇总了Python中Parser.Parser.limitContinents方法的典型用法代码示例。如果您正苦于以下问题：Python Parser.limitContinents方法的具体用法？Python Parser.limitContinents怎么用？Python Parser.limitContinents使用的例子？那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在类Parser.Parser的用法示例。
在下文中一共展示了Parser.limitContinents方法的2个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于系统推荐出更棒的Python代码示例。
示例1: Scraper
# 需要导入模块: from Parser import Parser [as 别名]
# 或者: from Parser.Parser import limitContinents [as 别名]
SCRAPER_CACHE_DIR = '/home/bobbruno/workspace/BeerApp/dumps/'
accounts = [('Eo8xsuVxwG1V', '[email protected]', 'Eo8xsuVxwG1V01'),
('928vr9z45T7b', '[email protected]', '928vr9z45T7b01'),
('sYprtRIeu2GF', '[email protected]', 'sYprtRIeu2GF01')]
uaS = ['Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36',
'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20120101 Firefox/29.0',
'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1944.0 Safari/537.36',
'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.67 Safari/537.36']
beerScraper = Scraper(sleepTime=3, cacheDir=SCRAPER_CACHE_DIR, verbose=True, uaString=uaS[2])
beerParser = Parser(scraper=beerScraper, loc=SCRAPER_CACHE_DIR + 'dummy/')
beerParser.limitCountries(set([u'England', u'Ireland', u'Other United Kingdom', u'Belgium', u'Germany', u'United States']))
beerParser.limitContinents(set([u'Europe']))
beerScraper.login(accounts[1][0], accounts[1][2],
'http://www.ratebeer.com/login.asp',
'signin', 'http://www.ratebeer.com')
beerData = beerParser.parseContinents('http://www.ratebeer.com/breweries/')
# Now let's get some beers from a brewery
# I can get:
# Associated place: <span class="beerfoot"></span>.
# nextSibling.nextSibling.firstChild: get href and text
# website: from previous last sibling, nextSibling.firstChild:get href and text
# facebook,
# email
# The beer list with:示例2: Scraper
# 需要导入模块: from Parser import Parser [as 别名]
# 或者: from Parser.Parser import limitContinents [as 别名]
SCRAPER_CACHE_DIR = '/home/bobbruno/workspace/BeerApp/dumps/'
accounts = [('Eo8xsuVxwG1V', '[email protected]', 'Eo8xsuVxwG1V01'),
('928vr9z45T7b', '[email protected]', '928vr9z45T7b01'),
('sYprtRIeu2GF', '[email protected]', 'sYprtRIeu2GF01')]
uaS = ['Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/37.0.2062.120 Safari/537.36',
'Mozilla/5.0 (Windows NT 6.1; WOW64; rv:29.0) Gecko/20120101 Firefox/29.0',
'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_9_2) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1944.0 Safari/537.36',
'Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/36.0.1985.67 Safari/537.36']
beerScraper = Scraper(sleepTime=3, cacheDir=SCRAPER_CACHE_DIR, verbose=True, uaString=uaS[3])
beerParser = Parser(scraper=beerScraper, loc=SCRAPER_CACHE_DIR + 'dummy2/')
beerParser.limitCountries(set([u'England', u'Ireland', u'Other United Kingdom', u'Belgium', u'Germany', u'United States']))
beerParser.limitContinents(set([u'North America']))
beerParser.limitLocations(set([u'New Jersey', u'New Mexico', u'New York', u'North Carolina', u'North Dakota',
u'Ohio', u'Oklahoma', u'Oregon', u'Pennsylvania', u'Rhode Island', u'South Dakota',
u'Tennessee', u'Texas', u'Utah', u'Vermont', u'Virginia', u'Washington', u'Washington DC',
u'West Virginia', u'Wisconsin', u'Wyoming']))
beerScraper.login(accounts[2][0], accounts[2][2],
'http://www.ratebeer.com/login.asp',
'signin', 'http://www.ratebeer.com')
profile_filename = 'Modeler.DBLoad_profile.txt'
cProfile.run('beerParser.parseContinents("http://www.ratebeer.com/breweries/")', profile_filename)
statsfile = open("profile_stats.txt", "wb")
p = pstats.Stats(profile_filename, stream=statsfile)
stats = p.strip_dirs().sort_stats('cumulative')
stats.print_stats()
statsfile.close()