当前位置: 首页>>代码示例>>Java>>正文


Java TableInputFormat.addColumns方法代码示例

本文整理汇总了Java中org.apache.hadoop.hbase.mapreduce.TableInputFormat.addColumns方法的典型用法代码示例。如果您正苦于以下问题:Java TableInputFormat.addColumns方法的具体用法?Java TableInputFormat.addColumns怎么用?Java TableInputFormat.addColumns使用的例子?那么, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.hadoop.hbase.mapreduce.TableInputFormat的用法示例。


在下文中一共展示了TableInputFormat.addColumns方法的2个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: verifyAttempt

import org.apache.hadoop.hbase.mapreduce.TableInputFormat; //导入方法依赖的package包/类
/**
 * Looks at every value of the mapreduce output and verifies that indeed
 * the values have been reversed.
 * @param table Table to scan.
 * @throws IOException
 * @throws NullPointerException if we failed to find a cell value
 */
private void verifyAttempt(final HTable table) throws IOException, NullPointerException {
  Scan scan = new Scan();
  TableInputFormat.addColumns(scan, columns);
  ResultScanner scanner = table.getScanner(scan);
  try {
    Iterator<Result> itr = scanner.iterator();
    assertTrue(itr.hasNext());
    while(itr.hasNext()) {
      Result r = itr.next();
      if (LOG.isDebugEnabled()) {
        if (r.size() > 2 ) {
          throw new IOException("Too many results, expected 2 got " +
            r.size());
        }
      }
      byte[] firstValue = null;
      byte[] secondValue = null;
      int count = 0;
       for(KeyValue kv : r.list()) {
        if (count == 0) {
          firstValue = kv.getValue();
        }
        if (count == 1) {
          secondValue = kv.getValue();
        }
        count++;
        if (count == 2) {
          break;
        }
      }


      String first = "";
      if (firstValue == null) {
        throw new NullPointerException(Bytes.toString(r.getRow()) +
          ": first value is null");
      }
      first = new String(firstValue, HConstants.UTF8_ENCODING);

      String second = "";
      if (secondValue == null) {
        throw new NullPointerException(Bytes.toString(r.getRow()) +
          ": second value is null");
      }
      byte[] secondReversed = new byte[secondValue.length];
      for (int i = 0, j = secondValue.length - 1; j >= 0; j--, i++) {
        secondReversed[i] = secondValue[j];
      }
      second = new String(secondReversed, HConstants.UTF8_ENCODING);

      if (first.compareTo(second) != 0) {
        if (LOG.isDebugEnabled()) {
          LOG.debug("second key is not the reverse of first. row=" +
              r.getRow() + ", first value=" + first + ", second value=" +
              second);
        }
        fail();
      }
    }
  } finally {
    scanner.close();
  }
}
 
开发者ID:fengchen8086,项目名称:LCIndex-HBase-0.94.16,代码行数:71,代码来源:TestTableMapReduce.java

示例2: verifyAttempt

import org.apache.hadoop.hbase.mapreduce.TableInputFormat; //导入方法依赖的package包/类
/**
 * Looks at every value of the mapreduce output and verifies that indeed
 * the values have been reversed.
 * @param table Table to scan.
 * @throws IOException
 * @throws NullPointerException if we failed to find a cell value
 */
private void verifyAttempt(final HTable table) throws IOException, NullPointerException {
  Scan scan = new Scan();
  TableInputFormat.addColumns(scan, columns);
  ResultScanner scanner = table.getScanner(scan);
  try {
    Iterator<Result> itr = scanner.iterator();
    assertTrue(itr.hasNext());
    while(itr.hasNext()) {
      Result r = itr.next();
      if (LOG.isDebugEnabled()) {
        if (r.size() > 2 ) {
          throw new IOException("Too many results, expected 2 got " +
            r.size());
        }
      }
      byte[] firstValue = null;
      byte[] secondValue = null;
      int count = 0;
       for(KeyValue kv : r.list()) {
        if (count == 0) {
          firstValue = kv.getValue();
        }
        if (count == 1) {
          secondValue = kv.getValue();
        }
        count++;
        if (count == 2) {
          break;
        }
      }


      String first = "";
      if (firstValue == null) {
        throw new NullPointerException(Bytes.toString(r.getRow()) +
          ": first value is null");
      }
      first = Bytes.toString(firstValue);

      String second = "";
      if (secondValue == null) {
        throw new NullPointerException(Bytes.toString(r.getRow()) +
          ": second value is null");
      }
      byte[] secondReversed = new byte[secondValue.length];
      for (int i = 0, j = secondValue.length - 1; j >= 0; j--, i++) {
        secondReversed[i] = secondValue[j];
      }
      second = Bytes.toString(secondReversed);

      if (first.compareTo(second) != 0) {
        if (LOG.isDebugEnabled()) {
          LOG.debug("second key is not the reverse of first. row=" +
              r.getRow() + ", first value=" + first + ", second value=" +
              second);
        }
        fail();
      }
    }
  } finally {
    scanner.close();
  }
}
 
开发者ID:daidong,项目名称:DominoHBase,代码行数:71,代码来源:TestTableMapReduce.java


注:本文中的org.apache.hadoop.hbase.mapreduce.TableInputFormat.addColumns方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。