当前位置: 首页>>代码示例>>Java>>正文


Java DistributedCache.getLocalCacheArchives方法代码示例

本文整理汇总了Java中org.apache.hadoop.filecache.DistributedCache.getLocalCacheArchives方法的典型用法代码示例。如果您正苦于以下问题:Java DistributedCache.getLocalCacheArchives方法的具体用法?Java DistributedCache.getLocalCacheArchives怎么用?Java DistributedCache.getLocalCacheArchives使用的例子?那么, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.hadoop.filecache.DistributedCache的用法示例。


在下文中一共展示了DistributedCache.getLocalCacheArchives方法的2个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: findSolrConfig

import org.apache.hadoop.filecache.DistributedCache; //导入方法依赖的package包/类
public static Path findSolrConfig(Configuration conf) throws IOException {
  Path solrHome = null;
  // FIXME when mrunit supports the new cache apis
  //URI[] localArchives = context.getCacheArchives();
  Path[] localArchives = DistributedCache.getLocalCacheArchives(conf);
  if (localArchives.length == 0) {
    throw new IOException(String.format(Locale.ENGLISH,
        "No local cache archives, where is %s:%s", SolrOutputFormat
            .getSetupOk(), SolrOutputFormat.getZipName(conf)));
  }
  for (Path unpackedDir : localArchives) {
    // Only logged if debugging
    if (LOG.isDebugEnabled()) {
      LOG.debug(String.format(Locale.ENGLISH, "Examining unpack directory %s for %s",
          unpackedDir, SolrOutputFormat.getZipName(conf)));

      ProcessBuilder lsCmd = new ProcessBuilder(new String[] { "/bin/ls",
          "-lR", unpackedDir.toString() });
      lsCmd.redirectErrorStream();
      Process ls = lsCmd.start();
      byte[] buf = new byte[16 * 1024];
      InputStream all = ls.getInputStream();
      try {
        int count;
        while ((count = all.read(buf)) >= 0) {
          System.err.write(buf, 0, count);
        }
      } catch (IOException ignore) {
      } finally {
        all.close();
      }
      String exitValue;
      try {
        exitValue = String.valueOf(ls.waitFor());
      } catch (InterruptedException e) {
        exitValue = "interrupted";
      }
      System.err.format(Locale.ENGLISH, "Exit value of 'ls -lR' is %s%n", exitValue);
    }
    if (unpackedDir.getName().equals(SolrOutputFormat.getZipName(conf))) {
      LOG.info("Using this unpacked directory as solr home: {}", unpackedDir);
      solrHome = unpackedDir;
      break;
    }
  }

  return solrHome;
}
 
开发者ID:europeana,项目名称:search,代码行数:49,代码来源:SolrRecordWriter.java

示例2: getLocalCacheArchives

import org.apache.hadoop.filecache.DistributedCache; //导入方法依赖的package包/类
/**
 * Return the path array of the localized caches
 * @return A path array of localized caches
 * @throws IOException
 */
public Path[] getLocalCacheArchives()
  throws IOException {
  return DistributedCache.getLocalCacheArchives(conf);
}
 
开发者ID:Nextzero,项目名称:hadoop-2.6.0-cdh5.4.3,代码行数:10,代码来源:JobContextImpl.java


注:本文中的org.apache.hadoop.filecache.DistributedCache.getLocalCacheArchives方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。