当前位置: 首页>>代码示例>>Java>>正文


Java JobStatus.KILLED属性代码示例

本文整理汇总了Java中org.apache.hadoop.mapred.JobStatus.KILLED属性的典型用法代码示例。如果您正苦于以下问题:Java JobStatus.KILLED属性的具体用法?Java JobStatus.KILLED怎么用?Java JobStatus.KILLED使用的例子?那么恭喜您, 这里精选的属性代码示例或许可以为您提供帮助。您也可以进一步了解该属性所在org.apache.hadoop.mapred.JobStatus的用法示例。


在下文中一共展示了JobStatus.KILLED属性的3个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: convertMapreduceState

/**
 * Convert map-reduce specific job status constants to Sqoop job status
 * constants.
 *
 * @param status Map-reduce job constant
 * @return Equivalent submission status
 */
private SubmissionStatus convertMapreduceState(int status) {
  if(status == JobStatus.PREP) {
    return SubmissionStatus.BOOTING;
  } else if (status == JobStatus.RUNNING) {
    return SubmissionStatus.RUNNING;
  } else if (status == JobStatus.FAILED) {
    return SubmissionStatus.FAILED;
  } else if (status == JobStatus.KILLED) {
    return SubmissionStatus.FAILED;
  } else if (status == JobStatus.SUCCEEDED) {
    return SubmissionStatus.SUCCEEDED;
  }

  throw new SqoopException(MapreduceSubmissionError.MAPREDUCE_0004,
    "Unknown status " + status);
}
 
开发者ID:vybs,项目名称:sqoop-on-spark,代码行数:23,代码来源:MapreduceSubmissionEngine.java

示例2: verifyACLPersistence

private void verifyACLPersistence() throws IOException,
    InterruptedException {

  // Set the job up.
  final JobConf myConf = mr.createJobConf();
  myConf.set(JobContext.JOB_ACL_VIEW_JOB, viewColleague + " group2");

  // Submit the job as user1
  RunningJob job = submitJobAsUser(myConf, jobSubmitter);

  final JobID jobId = job.getID();

  // Kill the job and wait till it is actually killed so that it is written to
  // CompletedJobStore
  job.killJob();
  while (job.getJobState() != JobStatus.KILLED) {
    LOG.info("Waiting for the job to be killed successfully..");
    Thread.sleep(200);
  }

  // Now kill the cluster, so that the job is 'forgotten'
  tearDown();

  // Re-start the cluster
  startCluster(true);

  final JobConf myNewJobConf = mr.createJobConf();
  // Now verify view-job works off CompletedJobStore
  verifyViewJobAsAuthorizedUser(myNewJobConf, jobId, viewColleague);
  verifyViewJobAsAuthorizedUser(myNewJobConf, jobId, qAdmin);

  // Only JobCounters is persisted on the JobStore. So test counters only.
  UserGroupInformation unauthorizedUGI =
      UserGroupInformation.createUserForTesting(
          modifyColleague, new String[] {});

  unauthorizedUGI.doAs(new PrivilegedExceptionAction<Object>() {
    @SuppressWarnings("null")
    @Override
    public Object run() {
      RunningJob myJob = null;
      try {
        JobClient client = new JobClient(myNewJobConf);
        myJob = client.getJob(jobId);
      } catch (Exception e) {
        fail("Exception .." + e);
      }

      assertNotNull("Job " + jobId + " is not known to the JobTracker!",
          myJob);

      // Tests authorization failure with getCounters
      try {
        myJob.getCounters();
        fail("'cannot perform operation VIEW_JOB_COUNTERS' expected..");
      } catch (IOException ioe) {
        assertTrue(ioe.getMessage(), ioe.getMessage().contains("cannot perform operation VIEW_JOB_COUNTERS"));
      }

      return null;
    }
  });

}
 
开发者ID:Nextzero,项目名称:hadoop-2.6.0-cdh5.4.3,代码行数:64,代码来源:TestJobACLs.java

示例3: verifyACLPersistence

private void verifyACLPersistence() throws IOException,
    InterruptedException {

  // Set the job up.
  final JobConf myConf = mr.createJobConf();
  myConf.set(JobContext.JOB_ACL_VIEW_JOB, viewColleague + " group2");

  // Submit the job as user1
  RunningJob job = submitJobAsUser(myConf, jobSubmitter);

  final JobID jobId = job.getID();

  // Kill the job and wait till it is actually killed so that it is written to
  // CompletedJobStore
  job.killJob();
  while (job.getJobState() != JobStatus.KILLED) {
    LOG.info("Waiting for the job to be killed successfully..");
    Thread.sleep(200);
  }

  // Now kill the cluster, so that the job is 'forgotten'
  tearDown();

  // Re-start the cluster
  startCluster(true);

  final JobConf myNewJobConf = mr.createJobConf();
  // Now verify view-job works off CompletedJobStore
  verifyViewJobAsAuthorizedUser(myNewJobConf, jobId, viewColleague);
  verifyViewJobAsAuthorizedUser(myNewJobConf, jobId, qAdmin);

  // Only JobCounters is persisted on the JobStore. So test counters only.
  UserGroupInformation unauthorizedUGI =
      UserGroupInformation.createUserForTesting(
          modifyColleague, new String[] {});

  unauthorizedUGI.doAs(new PrivilegedExceptionAction<Object>() {
    @SuppressWarnings("null")
    @Override
    public Object run() {
      RunningJob myJob = null;
      try {
        JobClient client = new JobClient(myNewJobConf);
        myJob = client.getJob(jobId);
      } catch (Exception e) {
        fail("Exception .." + e);
      }

      assertNotNull("Job " + jobId + " is not known to the JobTracker!",
          myJob);

      // Tests authorization failure with getCounters
      try {
        myJob.getCounters();
        fail("AccessControlException expected..");
      } catch (IOException ioe) {
        assertTrue(ioe.getMessage().contains("AccessControlException"));
      }

      return null;
    }
  });

}
 
开发者ID:Seagate,项目名称:hadoop-on-lustre,代码行数:64,代码来源:TestJobACLs.java


注:本文中的org.apache.hadoop.mapred.JobStatus.KILLED属性示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。