当前位置: 首页>>代码示例>>Java>>正文


Java ResourceUsageMetrics类代码示例

本文整理汇总了Java中org.apache.hadoop.tools.rumen.ResourceUsageMetrics的典型用法代码示例。如果您正苦于以下问题:Java ResourceUsageMetrics类的具体用法?Java ResourceUsageMetrics怎么用?Java ResourceUsageMetrics使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。


ResourceUsageMetrics类属于org.apache.hadoop.tools.rumen包,在下文中一共展示了ResourceUsageMetrics类的6个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: ResourceUsageMatcherRunner

import org.apache.hadoop.tools.rumen.ResourceUsageMetrics; //导入依赖的package包/类
ResourceUsageMatcherRunner(final TaskInputOutputContext context, 
                           ResourceUsageMetrics metrics) {
  Configuration conf = context.getConfiguration();
  
  // set the resource calculator plugin
  Class<? extends ResourceCalculatorPlugin> clazz =
    conf.getClass(TTConfig.TT_RESOURCE_CALCULATOR_PLUGIN,
                  null, ResourceCalculatorPlugin.class);
  ResourceCalculatorPlugin plugin = 
    ResourceCalculatorPlugin.getResourceCalculatorPlugin(clazz, conf);
  
  // set the other parameters
  this.sleepTime = conf.getLong(SLEEP_CONFIG, DEFAULT_SLEEP_TIME);
  progress = new BoostingProgress(context);
  
  // instantiate a resource-usage-matcher
  matcher = new ResourceUsageMatcher();
  matcher.configure(conf, plugin, metrics, progress);
}
 
开发者ID:naver,项目名称:hadoop,代码行数:20,代码来源:LoadJob.java

示例2: initialize

import org.apache.hadoop.tools.rumen.ResourceUsageMetrics; //导入依赖的package包/类
@Override
public void initialize(Configuration conf, ResourceUsageMetrics metrics,
                       ResourceCalculatorPlugin monitor,
                       Progressive progress) {
  this.monitor = monitor;
  this.progress = progress;
  
  // get the target CPU usage
  targetCpuUsage = metrics.getCumulativeCpuUsage();
  if (targetCpuUsage <= 0 ) {
    enabled = false;
    return;
  } else {
    enabled = true;
  }
  
  emulationInterval =  conf.getFloat(CPU_EMULATION_PROGRESS_INTERVAL, 
                                     DEFAULT_EMULATION_FREQUENCY);
  
  // calibrate the core cpu-usage utility
  emulatorCore.calibrate(monitor, targetCpuUsage);
  
  // initialize the states
  lastSeenProgress = 0;
  lastSeenCpuUsage = 0;
}
 
开发者ID:naver,项目名称:hadoop,代码行数:27,代码来源:CumulativeCpuUsageEmulatorPlugin.java

示例3: LoadSplit

import org.apache.hadoop.tools.rumen.ResourceUsageMetrics; //导入依赖的package包/类
public LoadSplit(CombineFileSplit cfsplit, int maps, int id, long inputBytes, 
                 long inputRecords, long outputBytes, long outputRecords, 
                 double[] reduceBytes, double[] reduceRecords, 
                 long[] reduceOutputBytes, long[] reduceOutputRecords,
                 ResourceUsageMetrics metrics,
                 ResourceUsageMetrics[] rMetrics)
throws IOException {
  super(cfsplit);
  this.id = id;
  this.maps = maps;
  reduces = reduceBytes.length;
  this.inputRecords = inputRecords;
  this.outputBytes = outputBytes;
  this.outputRecords = outputRecords;
  this.reduceBytes = reduceBytes;
  this.reduceRecords = reduceRecords;
  nSpec = reduceOutputBytes.length;
  this.reduceOutputBytes = reduceOutputBytes;
  this.reduceOutputRecords = reduceOutputRecords;
  this.mapMetrics = metrics;
  this.reduceMetrics = rMetrics;
}
 
开发者ID:naver,项目名称:hadoop,代码行数:23,代码来源:LoadSplit.java

示例4: getLoadSplit

import org.apache.hadoop.tools.rumen.ResourceUsageMetrics; //导入依赖的package包/类
private LoadSplit getLoadSplit() throws Exception {

    Path[] files = {new Path("one"), new Path("two")};
    long[] start = {1, 2};
    long[] lengths = {100, 200};
    String[] locations = {"locOne", "loctwo"};

    CombineFileSplit cfSplit = new CombineFileSplit(files, start, lengths,
            locations);
    ResourceUsageMetrics metrics = new ResourceUsageMetrics();
    metrics.setCumulativeCpuUsage(200);
    ResourceUsageMetrics[] rMetrics = {metrics};

    double[] reduceBytes = {8.1d, 8.2d};
    double[] reduceRecords = {9.1d, 9.2d};
    long[] reduceOutputBytes = {101L, 102L};
    long[] reduceOutputRecords = {111L, 112L};

    return new LoadSplit(cfSplit, 2, 1, 4L, 5L, 6L, 7L,
            reduceBytes, reduceRecords, reduceOutputBytes, reduceOutputRecords,
            metrics, rMetrics);
  }
 
开发者ID:naver,项目名称:hadoop,代码行数:23,代码来源:TestGridMixClasses.java

示例5: testEmulationAccuracy

import org.apache.hadoop.tools.rumen.ResourceUsageMetrics; //导入依赖的package包/类
private static void testEmulationAccuracy(Configuration conf, 
                      FakeCpuUsageEmulatorCore fakeCore,
                      ResourceCalculatorPlugin monitor,
                      ResourceUsageMetrics metrics,
                      CumulativeCpuUsageEmulatorPlugin cpuPlugin,
                      long expectedTotalCpuUsage, long expectedTotalNumCalls) 
throws Exception {
  FakeProgressive fakeProgress = new FakeProgressive();
  fakeCore.reset();
  cpuPlugin.initialize(conf, metrics, monitor, fakeProgress);
  int numLoops = 0;
  while (fakeProgress.getProgress() < 1) {
    ++numLoops;
    float progress = (float)numLoops / 100;
    fakeProgress.setProgress(progress);
    cpuPlugin.emulate();
  }
  
  // test if the resource plugin shows the expected invocations
  assertEquals("Cumulative cpu usage emulator plugin failed (num calls)!", 
               expectedTotalNumCalls, fakeCore.getNumCalls(), 0L);
  // test if the resource plugin shows the expected usage
  assertEquals("Cumulative cpu usage emulator plugin failed (total usage)!", 
               expectedTotalCpuUsage, fakeCore.getCpuUsage(), 0L);
}
 
开发者ID:naver,项目名称:hadoop,代码行数:26,代码来源:TestResourceUsageEmulators.java

示例6: testEmulationAccuracy

import org.apache.hadoop.tools.rumen.ResourceUsageMetrics; //导入依赖的package包/类
private static void testEmulationAccuracy(Configuration conf, 
                      FakeHeapUsageEmulatorCore fakeCore,
                      ResourceCalculatorPlugin monitor,
                      ResourceUsageMetrics metrics,
                      TotalHeapUsageEmulatorPlugin heapPlugin,
                      long expectedTotalHeapUsageInMB,
                      long expectedTotalNumCalls)
throws Exception {
  FakeProgressive fakeProgress = new FakeProgressive();
  fakeCore.resetFake();
  heapPlugin.initialize(conf, metrics, monitor, fakeProgress);
  int numLoops = 0;
  while (fakeProgress.getProgress() < 1) {
    ++numLoops;
    float progress = numLoops / 100.0F;
    fakeProgress.setProgress(progress);
    heapPlugin.emulate();
  }
  
  // test if the resource plugin shows the expected usage
  assertEquals("Cumulative heap usage emulator plugin failed (total usage)!", 
               expectedTotalHeapUsageInMB, fakeCore.getHeapUsageInMB(), 1L);
  // test if the resource plugin shows the expected num calls
  assertEquals("Cumulative heap usage emulator plugin failed (num calls)!", 
               expectedTotalNumCalls, fakeCore.getNumCalls(), 0L);
}
 
开发者ID:naver,项目名称:hadoop,代码行数:27,代码来源:TestGridmixMemoryEmulation.java


注:本文中的org.apache.hadoop.tools.rumen.ResourceUsageMetrics类示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。