当前位置: 首页>>代码示例>>Java>>正文


Java ZKSplitLog.isCorrupted方法代码示例

本文整理汇总了Java中org.apache.hadoop.hbase.zookeeper.ZKSplitLog.isCorrupted方法的典型用法代码示例。如果您正苦于以下问题:Java ZKSplitLog.isCorrupted方法的具体用法?Java ZKSplitLog.isCorrupted怎么用?Java ZKSplitLog.isCorrupted使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.hadoop.hbase.zookeeper.ZKSplitLog的用法示例。


在下文中一共展示了ZKSplitLog.isCorrupted方法的4个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: finishSplitLogFile

import org.apache.hadoop.hbase.zookeeper.ZKSplitLog; //导入方法依赖的package包/类
public static void finishSplitLogFile(Path rootdir, Path oldLogDir,
    String logfile, Configuration conf) throws IOException {
  List<Path> processedLogs = new ArrayList<Path>();
  List<Path> corruptedLogs = new ArrayList<Path>();
  FileSystem fs;
  fs = rootdir.getFileSystem(conf);
  Path logPath = new Path(logfile);
  if (ZKSplitLog.isCorrupted(rootdir, logPath.getName(), fs)) {
    corruptedLogs.add(logPath);
  } else {
    processedLogs.add(logPath);
  }
  archiveLogs(null, corruptedLogs, processedLogs, oldLogDir, fs, conf);
  Path stagingDir = ZKSplitLog.getSplitLogDir(rootdir, logPath.getName());
  HBaseFileSystem.deleteDirFromFileSystem(fs, stagingDir);
}
 
开发者ID:fengchen8086,项目名称:LCIndex-HBase-0.94.16,代码行数:17,代码来源:HLogSplitter.java

示例2: finishSplitLogFile

import org.apache.hadoop.hbase.zookeeper.ZKSplitLog; //导入方法依赖的package包/类
static void finishSplitLogFile(Path rootdir, Path oldLogDir,
    Path logPath, Configuration conf) throws IOException {
  List<Path> processedLogs = new ArrayList<Path>();
  List<Path> corruptedLogs = new ArrayList<Path>();
  FileSystem fs;
  fs = rootdir.getFileSystem(conf);
  if (ZKSplitLog.isCorrupted(rootdir, logPath.getName(), fs)) {
    corruptedLogs.add(logPath);
  } else {
    processedLogs.add(logPath);
  }
  archiveLogs(corruptedLogs, processedLogs, oldLogDir, fs, conf);
  Path stagingDir = ZKSplitLog.getSplitLogDir(rootdir, logPath.getName());
  fs.delete(stagingDir, true);
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:16,代码来源:WALSplitter.java

示例3: finishSplitLogFile

import org.apache.hadoop.hbase.zookeeper.ZKSplitLog; //导入方法依赖的package包/类
private static void finishSplitLogFile(Path rootdir, Path oldLogDir,
    Path logPath, Configuration conf) throws IOException {
  List<Path> processedLogs = new ArrayList<>();
  List<Path> corruptedLogs = new ArrayList<>();
  FileSystem fs;
  fs = rootdir.getFileSystem(conf);
  if (ZKSplitLog.isCorrupted(rootdir, logPath.getName(), fs)) {
    corruptedLogs.add(logPath);
  } else {
    processedLogs.add(logPath);
  }
  archiveLogs(corruptedLogs, processedLogs, oldLogDir, fs, conf);
  Path stagingDir = ZKSplitLog.getSplitLogDir(rootdir, logPath.getName());
  fs.delete(stagingDir, true);
}
 
开发者ID:apache,项目名称:hbase,代码行数:16,代码来源:WALSplitter.java

示例4: moveRecoveredEditsFromTemp

import org.apache.hadoop.hbase.zookeeper.ZKSplitLog; //导入方法依赖的package包/类
public static void moveRecoveredEditsFromTemp(String tmpname,
    Path rootdir, Path oldLogDir,
    String logfile, Configuration conf)
throws IOException{
  List<Path> processedLogs = new ArrayList<Path>();
  List<Path> corruptedLogs = new ArrayList<Path>();
  FileSystem fs;
  fs = rootdir.getFileSystem(conf);
  Path logPath = new Path(logfile);
  if (ZKSplitLog.isCorrupted(rootdir, tmpname, fs)) {
    corruptedLogs.add(logPath);
  } else {
    processedLogs.add(logPath);
  }
  Path stagingDir = ZKSplitLog.getSplitLogDir(rootdir, tmpname);
  List<FileStatus> files = listAll(fs, stagingDir);
  for (FileStatus f : files) {
    Path src = f.getPath();
    Path dst = ZKSplitLog.stripSplitLogTempDir(rootdir, src);
    if (ZKSplitLog.isCorruptFlagFile(dst)) {
      continue;
    }
    if (fs.exists(src)) {
      if (fs.exists(dst)) {
        fs.delete(dst, false);
      } else {
        Path dstdir = dst.getParent();
        if (!fs.exists(dstdir)) {
          if (!fs.mkdirs(dstdir)) LOG.warn("mkdir failed on " + dstdir);
        }
      }
      fs.rename(src, dst);
      LOG.debug(" moved " + src + " => " + dst);
    } else {
      LOG.debug("Could not move recovered edits from " + src +
          " as it doesn't exist");
    }
  }
  archiveLogs(null, corruptedLogs, processedLogs,
      oldLogDir, fs, conf);
  fs.delete(stagingDir, true);
  return;
}
 
开发者ID:lifeng5042,项目名称:RStore,代码行数:44,代码来源:HLogSplitter.java


注:本文中的org.apache.hadoop.hbase.zookeeper.ZKSplitLog.isCorrupted方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。