本文整理匯總了Python中scrapy.http.request.Request.meta["index"]方法的典型用法代碼示例。如果您正苦於以下問題:Python Request.meta["index"]方法的具體用法?Python Request.meta["index"]怎麽用?Python Request.meta["index"]使用的例子?那麽, 這裏精選的方法代碼示例或許可以為您提供幫助。您也可以進一步了解該方法所在類scrapy.http.request.Request
的用法示例。
在下文中一共展示了Request.meta["index"]方法的1個代碼示例,這些例子默認根據受歡迎程度排序。您可以為喜歡或者感覺有用的代碼點讚,您的評價將有助於係統推薦出更棒的Python代碼示例。
示例1: parse
# 需要導入模塊: from scrapy.http.request import Request [as 別名]
# 或者: from scrapy.http.request.Request import meta["index"] [as 別名]
def parse(self, resp):
hxs = Selector(resp)
base_url = "http://www.mangareader.net"
page_links = hxs.xpath("//select[@id='pageMenu']/option/@value").extract()
item = MangaImagesItem()
item["chapter_url"] = resp.url
item["chapter_name"] = hxs.xpath("//div[@id='mangainfo']//h1/text()").extract()[0]
item["total_images"] = len(page_links)
item["image_urls"] = []
# fetch the images from all the pages
for i, p in enumerate(page_links):
page = urljoin_rfc(base_url, p)
request = Request(page, callback=self.parse_img_url)
# pass the index of the image for reordering later
request.meta["index"] = i
request.meta["item"] = item # pass the item to the callback
yield request
yield item