本文整理汇总了Java中org.apache.giraph.conf.GiraphConfiguration.setYarnTaskHeapMb方法的典型用法代码示例。如果您正苦于以下问题：Java GiraphConfiguration.setYarnTaskHeapMb方法的具体用法？Java GiraphConfiguration.setYarnTaskHeapMb怎么用？Java GiraphConfiguration.setYarnTaskHeapMb使用的例子？那么, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在类org.apache.giraph.conf.GiraphConfiguration的用法示例。
在下文中一共展示了GiraphConfiguration.setYarnTaskHeapMb方法的2个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于系统推荐出更棒的Java代码示例。
示例1: setupYarnConfiguration
import org.apache.giraph.conf.GiraphConfiguration; //导入方法依赖的package包/类
/**
* Set up the GiraphConfiguration settings we need to run a no-op Giraph
* job on a MiniYARNCluster as an integration test. Some YARN-specific
* flags are set inside GiraphYarnClient and won't need to be set here.
*/
private void setupYarnConfiguration() throws IOException {
conf = new GiraphConfiguration();
conf.setWorkerConfiguration(1, 1, 100.0f);
conf.setMaxMasterSuperstepWaitMsecs(30 * 1000);
conf.setEventWaitMsecs(3 * 1000);
conf.setYarnLibJars(""); // no need
conf.setYarnTaskHeapMb(256); // small since no work to be done
conf.setComputationClass(DummyYarnComputation.class);
conf.setVertexInputFormatClass(IntIntNullTextInputFormat.class);
conf.setVertexOutputFormatClass(IdWithValueTextOutputFormat.class);
conf.setNumComputeThreads(1);
conf.setMaxTaskAttempts(1);
conf.setNumInputSplitsThreads(1);
// Giraph on YARN only ever things its running in "non-local" mode
conf.setLocalTestMode(false);
// this has to happen here before we populate the conf with the temp dirs
setupTempDirectories();
conf.set(OUTDIR, new Path(outputDir.getAbsolutePath()).toString());
GiraphFileInputFormat.addVertexInputPath(conf, new Path(inputDir.getAbsolutePath()));
// hand off the ZK info we just created to our no-op job
GiraphConstants.ZOOKEEPER_SERVERLIST_POLL_MSECS.set(conf, 500);
conf.setZooKeeperConfiguration(zkList);
conf.set(GiraphConstants.ZOOKEEPER_DIR, zkDir.getAbsolutePath());
GiraphConstants.ZOOKEEPER_MANAGER_DIRECTORY.set(conf, zkMgrDir.getAbsolutePath());
// without this, our "real" client won't connect w/"fake" YARN cluster
conf.setBoolean(YarnConfiguration.YARN_MINICLUSTER_FIXED_PORTS, true);
}
示例2: setupYarnConfiguration
import org.apache.giraph.conf.GiraphConfiguration; //导入方法依赖的package包/类
/**
* Set up the GiraphConfiguration settings we need to run a no-op Giraph
* job on a MiniYARNCluster as an integration test. Some YARN-specific
* flags are set inside GiraphYarnClient and won't need to be set here.
*/
private void setupYarnConfiguration() throws IOException {
conf = new GiraphConfiguration();
conf.setWorkerConfiguration(1, 1, 100.0f);
conf.setMaxMasterSuperstepWaitMsecs(30 * 1000);
conf.setEventWaitMsecs(3 * 1000);
conf.setYarnLibJars(""); // no need
conf.setYarnTaskHeapMb(256); // small since no work to be done
conf.setVertexClass(DummyYarnVertex.class);
conf.setVertexInputFormatClass(IntIntNullTextInputFormat.class);
conf.setVertexOutputFormatClass(IdWithValueTextOutputFormat.class);
conf.setNumComputeThreads(1);
conf.setMaxTaskAttempts(1);
conf.setNumInputSplitsThreads(1);
// Giraph on YARN only ever things its running in "non-local" mode
conf.setLocalTestMode(false);
// this has to happen here before we populate the conf with the temp dirs
setupTempDirectories();
conf.set(OUTDIR, new Path(outputDir.getAbsolutePath()).toString());
GiraphFileInputFormat.addVertexInputPath(conf, new Path(inputDir.getAbsolutePath()));
// hand off the ZK info we just created to our no-op job
GiraphConstants.ZOOKEEPER_SERVERLIST_POLL_MSECS.set(conf, 500);
conf.setZooKeeperConfiguration(zkList);
conf.set(GiraphConstants.ZOOKEEPER_DIR, zkDir.getAbsolutePath());
GiraphConstants.ZOOKEEPER_MANAGER_DIRECTORY.set(conf, zkMgrDir.getAbsolutePath());
// without this, our "real" client won't connect w/"fake" YARN cluster
conf.setBoolean(YarnConfiguration.YARN_MINICLUSTER_FIXED_PORTS, true);
}