当前位置: 首页>>代码示例>>Java>>正文


Java MapAttemptFinished类代码示例

本文整理汇总了Java中org.apache.hadoop.mapreduce.jobhistory.MapAttemptFinished的典型用法代码示例。如果您正苦于以下问题:Java MapAttemptFinished类的具体用法?Java MapAttemptFinished怎么用?Java MapAttemptFinished使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。


MapAttemptFinished类属于org.apache.hadoop.mapreduce.jobhistory包,在下文中一共展示了MapAttemptFinished类的3个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: processMapAttemptFinishedEvent

import org.apache.hadoop.mapreduce.jobhistory.MapAttemptFinished; //导入依赖的package包/类
private void processMapAttemptFinishedEvent(MapAttemptFinishedEvent event) {
  LoggedTaskAttempt attempt =
      getOrMakeTaskAttempt(event.getTaskType(), event.getTaskId().toString(),
          event.getAttemptId().toString());
  if (attempt == null) {
    return;
  }
  attempt.setResult(getPre21Value(event.getTaskStatus()));
  attempt.setHostName(event.getHostname());
  // XXX There may be redundant location info available in the event.
  // We might consider extracting it from this event. Currently this
  // is redundant, but making this will add future-proofing.
  attempt.setFinishTime(event.getFinishTime());
  attempt
      .incorporateCounters(((MapAttemptFinished) event.getDatum()).counters);
}
 
开发者ID:rekhajoshm,项目名称:mapreduce-fork,代码行数:17,代码来源:JobBuilder.java

示例2: processMapAttemptFinishedEvent

import org.apache.hadoop.mapreduce.jobhistory.MapAttemptFinished; //导入依赖的package包/类
private void processMapAttemptFinishedEvent(MapAttemptFinishedEvent event) {
  ParsedTaskAttempt attempt =
      getOrMakeTaskAttempt(event.getTaskType(), event.getTaskId().toString(),
          event.getAttemptId().toString());
  if (attempt == null) {
    return;
  }
  attempt.setResult(getPre21Value(event.getTaskStatus()));
  attempt.setHostName(event.getHostname(), event.getRackName());

  ParsedHost pHost = 
    getAndRecordParsedHost(event.getRackName(), event.getHostname());
  if (pHost != null) {
    attempt.setLocation(pHost.makeLoggedLocation());
  }
  
  // XXX There may be redundant location info available in the event.
  // We might consider extracting it from this event. Currently this
  // is redundant, but making this will add future-proofing.
  attempt.setFinishTime(event.getFinishTime());
  attempt
    .incorporateCounters(((MapAttemptFinished) event.getDatum()).counters);
  attempt.arraySetClockSplits(event.getClockSplits());
  attempt.arraySetCpuUsages(event.getCpuUsages());
  attempt.arraySetGpuUsages(event.getGpuUsages());
  attempt.arraySetVMemKbytes(event.getVMemKbytes());
  attempt.arraySetPhysMemKbytes(event.getPhysMemKbytes());
}
 
开发者ID:naver,项目名称:hadoop,代码行数:29,代码来源:JobBuilder.java

示例3: processMapAttemptFinishedEvent

import org.apache.hadoop.mapreduce.jobhistory.MapAttemptFinished; //导入依赖的package包/类
private void processMapAttemptFinishedEvent(MapAttemptFinishedEvent event) {
  ParsedTaskAttempt attempt =
      getOrMakeTaskAttempt(event.getTaskType(), event.getTaskId().toString(),
          event.getAttemptId().toString());
  if (attempt == null) {
    return;
  }
  attempt.setResult(getPre21Value(event.getTaskStatus()));
  attempt.setHostName(event.getHostname(), event.getRackName());

  ParsedHost pHost = 
    getAndRecordParsedHost(event.getRackName(), event.getHostname());
  if (pHost != null) {
    attempt.setLocation(pHost.makeLoggedLocation());
  }
  
  // XXX There may be redundant location info available in the event.
  // We might consider extracting it from this event. Currently this
  // is redundant, but making this will add future-proofing.
  attempt.setFinishTime(event.getFinishTime());
  attempt
    .incorporateCounters(((MapAttemptFinished) event.getDatum()).counters);
  attempt.arraySetClockSplits(event.getClockSplits());
  attempt.arraySetCpuUsages(event.getCpuUsages());
  attempt.arraySetVMemKbytes(event.getVMemKbytes());
  attempt.arraySetPhysMemKbytes(event.getPhysMemKbytes());
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:28,代码来源:JobBuilder.java


注:本文中的org.apache.hadoop.mapreduce.jobhistory.MapAttemptFinished类示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。