当前位置: 首页>>代码示例>>Java>>正文


Java FamilyDirFilter类代码示例

本文整理汇总了Java中org.apache.hadoop.hbase.util.FSUtils.FamilyDirFilter的典型用法代码示例。如果您正苦于以下问题:Java FamilyDirFilter类的具体用法?Java FamilyDirFilter怎么用?Java FamilyDirFilter使用的例子?那么, 这里精选的类代码示例或许可以为您提供帮助。


FamilyDirFilter类属于org.apache.hadoop.hbase.util.FSUtils包,在下文中一共展示了FamilyDirFilter类的3个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: checkRegionDir

import org.apache.hadoop.hbase.util.FSUtils.FamilyDirFilter; //导入依赖的package包/类
/**
 * Check all column families in a region dir.
 *
 * @param regionDir
 *          region directory
 * @throws IOException
 */
protected void checkRegionDir(Path regionDir) throws IOException {
  FileStatus[] cfs = null;
  try {
    cfs = fs.listStatus(regionDir, new FamilyDirFilter(fs));
  } catch (FileNotFoundException fnfe) {
    // Hadoop 0.23+ listStatus semantics throws an exception if the path does not exist.
    LOG.warn("Region Directory " + regionDir +
        " does not exist.  Likely due to concurrent split/compaction. Skipping.");
    missing.add(regionDir);
    return;
  }

  // Hadoop 1.0 listStatus does not throw an exception if the path does not exist.
  if (cfs.length == 0 && !fs.exists(regionDir)) {
    LOG.warn("Region Directory " + regionDir +
        " does not exist.  Likely due to concurrent split/compaction. Skipping.");
    missing.add(regionDir);
    return;
  }

  for (FileStatus cfFs : cfs) {
    Path cfDir = cfFs.getPath();
    checkColFamDir(cfDir);
  }
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:33,代码来源:HFileCorruptionChecker.java

示例2: checkMobRegionDir

import org.apache.hadoop.hbase.util.FSUtils.FamilyDirFilter; //导入依赖的package包/类
/**
 * Checks all the mob files of a table.
 * @param regionDir The mob region directory
 * @throws IOException
 */
private void checkMobRegionDir(Path regionDir) throws IOException {
  if (!fs.exists(regionDir)) {
    return;
  }
  FileStatus[] hfs = null;
  try {
    hfs = fs.listStatus(regionDir, new FamilyDirFilter(fs));
  } catch (FileNotFoundException fnfe) {
    // Hadoop 0.23+ listStatus semantics throws an exception if the path does not exist.
    LOG.warn("Mob directory " + regionDir
      + " does not exist.  Likely the table is deleted. Skipping.");
    missedMobFiles.add(regionDir);
    return;
  }

  // Hadoop 1.0 listStatus does not throw an exception if the path does not exist.
  if (hfs.length == 0 && !fs.exists(regionDir)) {
    LOG.warn("Mob directory " + regionDir
      + " does not exist.  Likely the table is deleted. Skipping.");
    missedMobFiles.add(regionDir);
    return;
  }
  for (FileStatus hfFs : hfs) {
    Path hf = hfFs.getPath();
    checkMobColFamDir(hf);
  }
}
 
开发者ID:apache,项目名称:hbase,代码行数:33,代码来源:HFileCorruptionChecker.java

示例3: checkRegionDir

import org.apache.hadoop.hbase.util.FSUtils.FamilyDirFilter; //导入依赖的package包/类
/**
 * Check all column families in a region dir.
 *
 * @param regionDir
 *          region directory
 * @throws IOException
 */
protected void checkRegionDir(Path regionDir) throws IOException {
  FileStatus[] statuses = null;
  try {
    statuses = fs.listStatus(regionDir);
  } catch (FileNotFoundException fnfe) {
    // Hadoop 0.23+ listStatus semantics throws an exception if the path does not exist.
    LOG.warn("Region Directory " + regionDir +
        " does not exist.  Likely due to concurrent split/compaction. Skipping.");
    missing.add(regionDir);
    return;
  }

  List<FileStatus> cfs = FSUtils.filterFileStatuses(statuses, new FamilyDirFilter(fs));
  // Hadoop 1.0 listStatus does not throw an exception if the path does not exist.
  if (cfs.isEmpty() && !fs.exists(regionDir)) {
    LOG.warn("Region Directory " + regionDir +
        " does not exist.  Likely due to concurrent split/compaction. Skipping.");
    missing.add(regionDir);
    return;
  }

  for (FileStatus cfFs : cfs) {
    Path cfDir = cfFs.getPath();
    checkColFamDir(cfDir);
  }
}
 
开发者ID:apache,项目名称:hbase,代码行数:34,代码来源:HFileCorruptionChecker.java


注:本文中的org.apache.hadoop.hbase.util.FSUtils.FamilyDirFilter类示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。