当前位置: 首页>>代码示例>>Java>>正文


Java JobStory.getOutcome方法代码示例

本文整理汇总了Java中org.apache.hadoop.tools.rumen.JobStory.getOutcome方法的典型用法代码示例。如果您正苦于以下问题:Java JobStory.getOutcome方法的具体用法?Java JobStory.getOutcome怎么用?Java JobStory.getOutcome使用的例子?那么, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.hadoop.tools.rumen.JobStory的用法示例。


在下文中一共展示了JobStory.getOutcome方法的4个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: buildDistCacheFilesList

import org.apache.hadoop.tools.rumen.JobStory; //导入方法依赖的package包/类
/**
 * Create the list of unique distributed cache files needed for all the
 * simulated jobs and write the list to a special file.
 * @param jsp job story producer for the trace
 * @return exit code
 * @throws IOException
 */
private int buildDistCacheFilesList(JobStoryProducer jsp) throws IOException {
  // Read all the jobs from the trace file and build the list of unique
  // distributed cache files.
  JobStory jobStory;
  while ((jobStory = jsp.getNextJob()) != null) {
    if (jobStory.getOutcome() == Pre21JobHistoryConstants.Values.SUCCESS && 
       jobStory.getSubmissionTime() >= 0) {
      updateHDFSDistCacheFilesList(jobStory);
    }
  }
  jsp.close();

  return writeDistCacheFilesList();
}
 
开发者ID:naver,项目名称:hadoop,代码行数:22,代码来源:DistributedCacheEmulator.java

示例2: getNextJobFiltered

import org.apache.hadoop.tools.rumen.JobStory; //导入方法依赖的package包/类
protected JobStory getNextJobFiltered() throws IOException {
 JobStory job;
 do {
   job = jobProducer.getNextJob();
 } while (job != null
     && (job.getOutcome() != Pre21JobHistoryConstants.Values.SUCCESS ||
         job.getSubmissionTime() < 0));
 return null == job ? null : new FilterJobStory(job) {
     @Override
     public TaskInfo getTaskInfo(TaskType taskType, int taskNumber) {
       return new MinTaskInfo(this.job.getTaskInfo(taskType, taskNumber));
      }
   };
}
 
开发者ID:Nextzero,项目名称:hadoop-2.6.0-cdh5.4.3,代码行数:15,代码来源:JobFactory.java

示例3: getNextJobFiltered

import org.apache.hadoop.tools.rumen.JobStory; //导入方法依赖的package包/类
private JobStory getNextJobFiltered() throws IOException {
  JobStory job;
  do {
    job = jobProducer.getNextJob();
  } while (job != null
      && (job.getOutcome() != Pre21JobHistoryConstants.Values.SUCCESS ||
          job.getSubmissionTime() < 0));
  return null == job ? null : new FilterJobStory(job) {
      @Override
      public TaskInfo getTaskInfo(TaskType taskType, int taskNumber) {
        return new MinTaskInfo(this.job.getTaskInfo(taskType, taskNumber));
      }
    };
}
 
开发者ID:rhli,项目名称:hadoop-EAR,代码行数:15,代码来源:JobFactory.java

示例4: getNextJobFiltered

import org.apache.hadoop.tools.rumen.JobStory; //导入方法依赖的package包/类
protected JobStory getNextJobFiltered() throws IOException {
  JobStory job = getNextJobFromTrace();
  // filter out the following jobs
  //    - unsuccessful jobs
  //    - jobs with missing submit-time
  //    - reduce only jobs
  // These jobs are not yet supported in Gridmix
  while (job != null &&
    (job.getOutcome() != Pre21JobHistoryConstants.Values.SUCCESS ||
      job.getSubmissionTime() < 0 || job.getNumberMaps() == 0)) {
    if (LOG.isDebugEnabled()) {
      List<String> reason = new ArrayList<String>();
      if (job.getOutcome() != Pre21JobHistoryConstants.Values.SUCCESS) {
        reason.add("STATE (" + job.getOutcome().name() + ")");
      }
      if (job.getSubmissionTime() < 0) {
        reason.add("SUBMISSION-TIME (" + job.getSubmissionTime() + ")");
      }
      if (job.getNumberMaps() == 0) {
        reason.add("ZERO-MAPS-JOB");
      }
      
      // TODO This should never happen. Probably we missed something!
      if (reason.size() == 0) {
        reason.add("N/A");
      }
      
      LOG.debug("Ignoring job " + job.getJobID() + " from the input trace."
                + " Reason: " + StringUtils.join(reason, ","));
    }
    job = getNextJobFromTrace();
  }
  return null == job ? null : new FilterJobStory(job) {
    @Override
    public TaskInfo getTaskInfo(TaskType taskType, int taskNumber) {
      TaskInfo info = this.job.getTaskInfo(taskType, taskNumber);
      if (info != null) {
        info = new MinTaskInfo(info);
      } else {
        info = new MinTaskInfo(new TaskInfo(0, 0, 0, 0, 0));
      }
      return info;
    }
  };
}
 
开发者ID:naver,项目名称:hadoop,代码行数:46,代码来源:JobFactory.java


注:本文中的org.apache.hadoop.tools.rumen.JobStory.getOutcome方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。