當前位置: 首頁>>代碼示例>>Java>>正文


Java DistributedCache.getLocalCacheArchives方法代碼示例

本文整理匯總了Java中org.apache.hadoop.filecache.DistributedCache.getLocalCacheArchives方法的典型用法代碼示例。如果您正苦於以下問題:Java DistributedCache.getLocalCacheArchives方法的具體用法?Java DistributedCache.getLocalCacheArchives怎麽用?Java DistributedCache.getLocalCacheArchives使用的例子?那麽, 這裏精選的方法代碼示例或許可以為您提供幫助。您也可以進一步了解該方法所在org.apache.hadoop.filecache.DistributedCache的用法示例。


在下文中一共展示了DistributedCache.getLocalCacheArchives方法的2個代碼示例,這些例子默認根據受歡迎程度排序。您可以為喜歡或者感覺有用的代碼點讚,您的評價將有助於係統推薦出更棒的Java代碼示例。

示例1: findSolrConfig

import org.apache.hadoop.filecache.DistributedCache; //導入方法依賴的package包/類
public static Path findSolrConfig(Configuration conf) throws IOException {
  Path solrHome = null;
  // FIXME when mrunit supports the new cache apis
  //URI[] localArchives = context.getCacheArchives();
  Path[] localArchives = DistributedCache.getLocalCacheArchives(conf);
  if (localArchives.length == 0) {
    throw new IOException(String.format(Locale.ENGLISH,
        "No local cache archives, where is %s:%s", SolrOutputFormat
            .getSetupOk(), SolrOutputFormat.getZipName(conf)));
  }
  for (Path unpackedDir : localArchives) {
    // Only logged if debugging
    if (LOG.isDebugEnabled()) {
      LOG.debug(String.format(Locale.ENGLISH, "Examining unpack directory %s for %s",
          unpackedDir, SolrOutputFormat.getZipName(conf)));

      ProcessBuilder lsCmd = new ProcessBuilder(new String[] { "/bin/ls",
          "-lR", unpackedDir.toString() });
      lsCmd.redirectErrorStream();
      Process ls = lsCmd.start();
      byte[] buf = new byte[16 * 1024];
      InputStream all = ls.getInputStream();
      try {
        int count;
        while ((count = all.read(buf)) >= 0) {
          System.err.write(buf, 0, count);
        }
      } catch (IOException ignore) {
      } finally {
        all.close();
      }
      String exitValue;
      try {
        exitValue = String.valueOf(ls.waitFor());
      } catch (InterruptedException e) {
        exitValue = "interrupted";
      }
      System.err.format(Locale.ENGLISH, "Exit value of 'ls -lR' is %s%n", exitValue);
    }
    if (unpackedDir.getName().equals(SolrOutputFormat.getZipName(conf))) {
      LOG.info("Using this unpacked directory as solr home: {}", unpackedDir);
      solrHome = unpackedDir;
      break;
    }
  }

  return solrHome;
}
 
開發者ID:europeana,項目名稱:search,代碼行數:49,代碼來源:SolrRecordWriter.java

示例2: getLocalCacheArchives

import org.apache.hadoop.filecache.DistributedCache; //導入方法依賴的package包/類
/**
 * Return the path array of the localized caches
 * @return A path array of localized caches
 * @throws IOException
 */
public Path[] getLocalCacheArchives()
  throws IOException {
  return DistributedCache.getLocalCacheArchives(conf);
}
 
開發者ID:Nextzero,項目名稱:hadoop-2.6.0-cdh5.4.3,代碼行數:10,代碼來源:JobContextImpl.java


注:本文中的org.apache.hadoop.filecache.DistributedCache.getLocalCacheArchives方法示例由純淨天空整理自Github/MSDocs等開源代碼及文檔管理平台,相關代碼片段篩選自各路編程大神貢獻的開源項目,源碼版權歸原作者所有,傳播和使用請參考對應項目的License;未經允許,請勿轉載。