本文整理汇总了Java中org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils.getConfiguredHistoryStagingDirPrefix方法的典型用法代码示例。如果您正苦于以下问题：Java JobHistoryUtils.getConfiguredHistoryStagingDirPrefix方法的具体用法？Java JobHistoryUtils.getConfiguredHistoryStagingDirPrefix怎么用？Java JobHistoryUtils.getConfiguredHistoryStagingDirPrefix使用的例子？那么, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在类org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils的用法示例。
在下文中一共展示了JobHistoryUtils.getConfiguredHistoryStagingDirPrefix方法的2个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于系统推荐出更棒的Java代码示例。
示例1: getPreviousJobHistoryFileStream
import org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils; //导入方法依赖的package包/类
public static FSDataInputStream getPreviousJobHistoryFileStream(
Configuration conf, ApplicationAttemptId applicationAttemptId)
throws IOException {
FSDataInputStream in = null;
Path historyFile = null;
String jobId =
TypeConverter.fromYarn(applicationAttemptId.getApplicationId())
.toString();
String jobhistoryDir =
JobHistoryUtils.getConfiguredHistoryStagingDirPrefix(conf, jobId);
Path histDirPath =
FileContext.getFileContext(conf).makeQualified(new Path(jobhistoryDir));
FileContext fc = FileContext.getFileContext(histDirPath.toUri(), conf);
// read the previous history file
historyFile =
fc.makeQualified(JobHistoryUtils.getStagingJobHistoryFile(histDirPath,
jobId, (applicationAttemptId.getAttemptId() - 1)));
LOG.info("History file is at " + historyFile);
in = fc.open(historyFile);
return in;
}
示例2: writeEarlySummaryFile
import org.apache.hadoop.mapreduce.v2.jobhistory.JobHistoryUtils; //导入方法依赖的package包/类
private Path writeEarlySummaryFile(JobId jobId, JobSummary jobSummary)
throws IOException {
Path stagingDir = new Path(
JobHistoryUtils.getConfiguredHistoryStagingDirPrefix(getConfig(),
jobId.toString()));
String doneSummaryFileName = JobHistoryUtils
.getIntermediateSummaryFileName(jobId);
Path qualifiedSummaryDoneFile = doneDirFS.makeQualified(new Path(
stagingDir, doneSummaryFileName));
return writeSummaryFile(qualifiedSummaryDoneFile, jobSummary);
}