本文整理汇总了Java中us.codecraft.webmagic.downloader.HttpClientDownloader类的典型用法代码示例。如果您正苦于以下问题：Java HttpClientDownloader类的具体用法？Java HttpClientDownloader怎么用？Java HttpClientDownloader使用的例子？那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。
HttpClientDownloader类属于us.codecraft.webmagic.downloader包，在下文中一共展示了HttpClientDownloader类的4个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于系统推荐出更棒的Java代码示例。
示例1: initComponent
import us.codecraft.webmagic.downloader.HttpClientDownloader; //导入依赖的package包/类
protected void initComponent() {
if (downloader == null) {
this.downloader = new HttpClientDownloader();
}
if (pipelines.isEmpty()) {
pipelines.add(new ConsolePipeline());
}
downloader.setThread(threadNum);
if (threadPool == null || threadPool.isShutdown()) {
if (executorService != null && !executorService.isShutdown()) {
threadPool = new CountableThreadPool(threadNum, executorService);
} else {
threadPool = new CountableThreadPool(threadNum);
}
}
if (startRequests != null) {
for (Request request : startRequests) {
addRequest(request);
}
startRequests.clear();
}
startTime = new Date();
}
示例2: checkComponent
import us.codecraft.webmagic.downloader.HttpClientDownloader; //导入依赖的package包/类
protected void checkComponent() {
if (downloader == null) {
this.downloader = new HttpClientDownloader();
}
if (pipelines.isEmpty()) {
pipelines.add(new ConsolePipeline());
}
downloader.setThread(threadNum);
}
示例3: SimpleHttpClient
import us.codecraft.webmagic.downloader.HttpClientDownloader; //导入依赖的package包/类
public SimpleHttpClient(Site site) {
this.site = site;
this.httpClientDownloader = new HttpClientDownloader();
}
示例4: main
import us.codecraft.webmagic.downloader.HttpClientDownloader; //导入依赖的package包/类
public static void main(String[] args) {
HttpClientDownloader downloader = new HttpClientDownloader();
// Html html = downloader.download("http://v.163.com/special/Khan/multiples.html","utf-8");
Html html = downloader.download("http://v.163.com/special/Khan/multiples.html");
System.out.println(html);
}