当前位置: 首页>>代码示例>>Java>>正文


Java MRClientService类代码示例

本文整理汇总了Java中org.apache.hadoop.mapreduce.v2.app.client.MRClientService的典型用法代码示例。如果您正苦于以下问题:Java MRClientService类的具体用法?Java MRClientService怎么用?Java MRClientService使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。


MRClientService类属于org.apache.hadoop.mapreduce.v2.app.client包,在下文中一共展示了MRClientService类的7个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: testMRWebAppSSLDisabled

import org.apache.hadoop.mapreduce.v2.app.client.MRClientService; //导入依赖的package包/类
@Test
public void testMRWebAppSSLDisabled() throws Exception {
  MRApp app = new MRApp(2, 2, true, this.getClass().getName(), true) {
    @Override
    protected ClientService createClientService(AppContext context) {
      return new MRClientService(context);
    }
  };
  Configuration conf = new Configuration();
  // MR is explicitly disabling SSL, even though setting as HTTPS_ONLY
  conf.set(YarnConfiguration.YARN_HTTP_POLICY_KEY, Policy.HTTPS_ONLY.name());
  Job job = app.submit(conf);

  String hostPort =
      NetUtils.getHostPortString(((MRClientService) app.getClientService())
        .getWebApp().getListenerAddress());
  // http:// should be accessible
  URL httpUrl = new URL("http://" + hostPort);
  HttpURLConnection conn = (HttpURLConnection) httpUrl.openConnection();
  InputStream in = conn.getInputStream();
  ByteArrayOutputStream out = new ByteArrayOutputStream();
  IOUtils.copyBytes(in, out, 1024);
  Assert.assertTrue(out.toString().contains("MapReduce Application"));

  // https:// is not accessible.
  URL httpsUrl = new URL("https://" + hostPort);
  try {
    HttpURLConnection httpsConn =
        (HttpURLConnection) httpsUrl.openConnection();
    httpsConn.getInputStream();
    Assert.fail("https:// is not accessible, expected to fail");
  } catch (Exception e) {
    Assert.assertTrue(e instanceof SSLException);
  }

  app.waitForState(job, JobState.SUCCEEDED);
  app.verifyCompleted();
}
 
开发者ID:naver,项目名称:hadoop,代码行数:39,代码来源:TestAMWebApp.java

示例2: testMRWebAppRedirection

import org.apache.hadoop.mapreduce.v2.app.client.MRClientService; //导入依赖的package包/类
@Test
public void testMRWebAppRedirection() throws Exception {

  String[] schemePrefix =
      { WebAppUtils.HTTP_PREFIX, WebAppUtils.HTTPS_PREFIX };
  for (String scheme : schemePrefix) {
    MRApp app = new MRApp(2, 2, true, this.getClass().getName(), true) {
      @Override
      protected ClientService createClientService(AppContext context) {
        return new MRClientService(context);
      }
    };
    Configuration conf = new Configuration();
    conf.set(YarnConfiguration.PROXY_ADDRESS, "9.9.9.9");
    conf.set(YarnConfiguration.YARN_HTTP_POLICY_KEY, scheme
      .equals(WebAppUtils.HTTPS_PREFIX) ? Policy.HTTPS_ONLY.name()
        : Policy.HTTP_ONLY.name());
    webProxyBase = "/proxy/" + app.getAppID();
    conf.set("hadoop.http.filter.initializers",
      TestAMFilterInitializer.class.getName());
    Job job = app.submit(conf);
    String hostPort =
        NetUtils.getHostPortString(((MRClientService) app.getClientService())
          .getWebApp().getListenerAddress());
    URL httpUrl = new URL("http://" + hostPort + "/mapreduce");

    HttpURLConnection conn = (HttpURLConnection) httpUrl.openConnection();
    conn.setInstanceFollowRedirects(false);
    conn.connect();
    String expectedURL =
        scheme + conf.get(YarnConfiguration.PROXY_ADDRESS)
            + ProxyUriUtils.getPath(app.getAppID(), "/mapreduce");
    Assert.assertEquals(expectedURL,
      conn.getHeaderField(HttpHeaders.LOCATION));
    Assert.assertEquals(HttpStatus.SC_MOVED_TEMPORARILY,
      conn.getResponseCode());
    app.waitForState(job, JobState.SUCCEEDED);
    app.verifyCompleted();
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:41,代码来源:TestAMWebApp.java

示例3: createClientService

import org.apache.hadoop.mapreduce.v2.app.client.MRClientService; //导入依赖的package包/类
@Override
protected ClientService createClientService(AppContext context) {
  return new MRClientService(context) {
    @Override
    public InetSocketAddress getBindAddress() {
      return NetUtils.createSocketAddr("localhost:9876");
    }

    @Override
    public int getHttpPort() {
      return -1;
    }
  };
}
 
开发者ID:naver,项目名称:hadoop,代码行数:15,代码来源:MRApp.java

示例4: createClientService

import org.apache.hadoop.mapreduce.v2.app.client.MRClientService; //导入依赖的package包/类
@Override
protected ClientService createClientService(AppContext context) {
  return new MRClientService(context) {
    @Override
    public void serviceStop() throws Exception {
      numStops++;
      clientServiceStopped = numStops;
      super.serviceStop();
    }
  };
}
 
开发者ID:naver,项目名称:hadoop,代码行数:12,代码来源:TestMRAppComponentDependencies.java

示例5: createClientService

import org.apache.hadoop.mapreduce.v2.app.client.MRClientService; //导入依赖的package包/类
protected ClientService createClientService(AppContext context) {
  return new MRClientService(context);
}
 
开发者ID:naver,项目名称:hadoop,代码行数:4,代码来源:MRAppMaster.java

示例6: createClientService

import org.apache.hadoop.mapreduce.v2.app.client.MRClientService; //导入依赖的package包/类
@Override
protected ClientService createClientService(AppContext context) {
  clientService = new MRClientService(context);
  return clientService;
}
 
开发者ID:naver,项目名称:hadoop,代码行数:6,代码来源:TestMRClientService.java

示例7: AMWebServices

import org.apache.hadoop.mapreduce.v2.app.client.MRClientService; //导入依赖的package包/类
@Inject
public AMWebServices(final App app, final AppContext context) {
  this.appCtx = context;
  this.app = app;
  this.service = new MRClientService(context);
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:7,代码来源:AMWebServices.java


注:本文中的org.apache.hadoop.mapreduce.v2.app.client.MRClientService类示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。