当前位置: 首页>>代码示例>>Java>>正文


Java SleepJob.run方法代码示例

本文整理汇总了Java中org.apache.hadoop.examples.SleepJob.run方法的典型用法代码示例。如果您正苦于以下问题:Java SleepJob.run方法的具体用法?Java SleepJob.run怎么用?Java SleepJob.run使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.hadoop.examples.SleepJob的用法示例。


在下文中一共展示了SleepJob.run方法的2个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: testSlots

import org.apache.hadoop.examples.SleepJob; //导入方法依赖的package包/类
@Test
public void testSlots() throws IOException {
  MiniMRCluster mr = null;
  try {
    JobConf jtConf = new JobConf();
    jtConf.set("mapred.tasktracker.instrumentation",
        MyTaskTrackerMetricsInst.class.getName());
    mr = new MiniMRCluster(1, "file:///", 1, null, null, jtConf);
    MyTaskTrackerMetricsInst instr = (MyTaskTrackerMetricsInst)
      mr.getTaskTrackerRunner(0).getTaskTracker()
      .getTaskTrackerInstrumentation();

    JobConf conf = mr.createJobConf();
    SleepJob job = new SleepJob();
    job.setConf(conf);
    int numMapTasks = 3;
    int numReduceTasks = 2;
    job.run(numMapTasks, numReduceTasks, 1, 1, 1, 1);

    synchronized (instr) {
      // 5 regular tasks + 2 setup/cleanup tasks.
      assertEquals(7, instr.complete);
      assertEquals(7, instr.end);
      assertEquals(7, instr.launch);
    }
  } finally {
    if (mr != null) {
      mr.shutdown();
    }
  }
}
 
开发者ID:Nextzero,项目名称:hadoop-2.6.0-cdh5.4.3,代码行数:32,代码来源:TestTaskTrackerInstrumentation.java

示例2: testSlots

import org.apache.hadoop.examples.SleepJob; //导入方法依赖的package包/类
public void testSlots() throws IOException {
  MiniMRCluster mr = null;
  try {
    JobConf jtConf = new JobConf();
    jtConf.set("mapred.jobtracker.instrumentation", 
        MyJobTrackerMetricsInst.class.getName());
    mr = new MiniMRCluster(2, "file:///", 3, null, null, jtConf);
    MyJobTrackerMetricsInst instr = (MyJobTrackerMetricsInst) 
      mr.getJobTrackerRunner().getJobTracker().getInstrumentation();

    JobConf conf = mr.createJobConf();
    SleepJob job = new SleepJob();
    job.setConf(conf);
    int numMapTasks = 3;
    int numReduceTasks = 2;
    job.run(numMapTasks, numReduceTasks, 10000, 1, 10000, 1);
    
    synchronized (instr) {
      //after the job completes, incr and decr should be equal
      assertEquals(instr.incrOccupiedMapSlots, 
          instr.decrOccupiedMapSlots);
      assertEquals(instr.incrOccupiedReduceSlots, 
          instr.decrOccupiedReduceSlots);
      assertEquals(instr.incrRunningMaps,
          instr.decrRunningMaps);
      assertEquals(instr.incrRunningReduces,
          instr.decrRunningReduces);
      assertEquals(instr.incrReservedMapSlots,
          instr.decrReservedMapSlots);
      assertEquals(instr.incrReservedReduceSlots,
          instr.decrReservedReduceSlots);
      
      //validate that atleast once the callbacks happened
      assertTrue(instr.incrOccupiedMapSlots > 0);
      assertTrue(instr.incrOccupiedReduceSlots > 0);
      assertTrue(instr.incrRunningMaps > 0);
      assertTrue(instr.incrRunningReduces > 0);
    }
  } finally {
    if (mr != null) {
      mr.shutdown();
    }
  }
}
 
开发者ID:Nextzero,项目名称:hadoop-2.6.0-cdh5.4.3,代码行数:45,代码来源:TestJobTrackerInstrumentation.java


注:本文中的org.apache.hadoop.examples.SleepJob.run方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。