当前位置: 首页>>代码示例>>Java>>正文


Java HStore.getLCIndexParameters方法代码示例

本文整理汇总了Java中org.apache.hadoop.hbase.regionserver.HStore.getLCIndexParameters方法的典型用法代码示例。如果您正苦于以下问题:Java HStore.getLCIndexParameters方法的具体用法?Java HStore.getLCIndexParameters怎么用?Java HStore.getLCIndexParameters使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.hadoop.hbase.regionserver.HStore的用法示例。


在下文中一共展示了HStore.getLCIndexParameters方法的3个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: LCIndexWriter

import org.apache.hadoop.hbase.regionserver.HStore; //导入方法依赖的package包/类
public LCIndexWriter(HStore store, Path hdfsTmpPath, TimeRangeTracker tracker)
    throws IOException {
  this.store = store;
  this.hdfsTmpPath = hdfsTmpPath;
  this.tableRelation = store.indexTableRelation;
  indexParameters = store.getLCIndexParameters();
  this.statMap = LCStatInfo2.parseStatString(tableRelation,
      store.getHRegion().getTableDesc().getValue(LCIndexConstant.LC_TABLE_DESC_RANGE_STR));
  this.tracker = tracker;
  Path dirPath = indexParameters.getTmpDirPath(hdfsTmpPath);
  if (indexParameters.getLCIndexFileSystem().exists(dirPath)) {
    indexParameters.getLCIndexFileSystem().mkdirs(dirPath);
  }
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:15,代码来源:LCIndexWriter.java

示例2: CommitJob

import org.apache.hadoop.hbase.regionserver.HStore; //导入方法依赖的package包/类
public CommitJob(HStore store, Path src, Path dest) {
  super(CommitJobQueue.getInstance().getJobQueueName());
  this.store = store;
  this.hdfsTmpPath = src;
  this.hdfsDestPath = dest;
  relatedFlushJob = FlushJobQueue.getInstance().findJobByRawPath(hdfsTmpPath);
  indexParameters = store.getLCIndexParameters();
  printMessage("CommitJob construction, hdfsTmpPath: " + hdfsTmpPath + ", hdfsDestPath: "
      + hdfsDestPath);
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:11,代码来源:CommitJobQueue.java

示例3: NormalCompactJob

import org.apache.hadoop.hbase.regionserver.HStore; //导入方法依赖的package包/类
public NormalCompactJob(HStore store, CompactionRequest request, Path writtenPath)
    throws IOException {
  super(store, request, writtenPath);
  printMessage("NormalCompactJob construction, hdfsPath: " + tmpHDFSPath);
  relatedJobs = new ArrayList<>();
  iFileMap = new TreeMap<>(Bytes.BYTES_COMPARATOR);
  missingPathMap = new TreeMap<>();
  indexParameters = store.getLCIndexParameters();
  // LC_Home/[tableName]/[regionId]/.tmp/[HFileId].lcindex
  for (Map.Entry<byte[], TreeSet<byte[]>> entry : store.indexTableRelation.getIndexFamilyMap()
      .entrySet()) {
    for (byte[] qualifier : entry.getValue()) {
      List<Path> iFilesToBeCompacted = new ArrayList<>();
      for (StoreFile compactedHFile : request.getFiles()) {
        // if family not match, skip
        if (!compactedHFile.getPath().getParent().getName()
            .equals(Bytes.toString(entry.getKey()))) {
          continue;
        }
        Path iFile = indexParameters.getLocalIFile(compactedHFile.getPath(), qualifier);
        iFilesToBeCompacted.add(iFile);
        LOG.info(
            "LCDBG, minor compact need iFile " + iFile.toString() + " for qualifier " + Bytes
                .toString(qualifier) + ", target: " + tmpHDFSPath);
        if (!indexParameters.getLCIndexFileSystem().exists(iFile)) {
          printMessage("finding the iFile to be compacted: " + iFile);
          // when missing, first find it in commit job, then in remote job
          BasicJob job =
              CommitJobQueue.getInstance().findJobByDestPath(compactedHFile.getPath());
          if (job == null) {
            job = CompleteCompactionJobQueue.getInstance()
                .findJobByDestPath(compactedHFile.getPath());
            if (job == null) {
              job = new RemoteJob(store, iFile, compactedHFile.getPath(), false);
              RemoteJobQueue.getInstance().addJob(job);
            }
          }
          printMessage("LCDBG, missing file " + iFile + " on HFile " + compactedHFile.getPath()
              + " relies on job: " + job.getClass().getName());
          missingPathMap.put(iFile, job);
        }
      }
      iFileMap.put(qualifier, iFilesToBeCompacted);
      printMessage(
          "LCDBG, minor compact on qualifier " + Bytes.toString(qualifier) + " with iFile.size="
              + iFilesToBeCompacted.size() + ", target: " + tmpHDFSPath);
    }
  }
}
 
开发者ID:fengchen8086,项目名称:ditb,代码行数:50,代码来源:CompactJobQueue.java


注:本文中的org.apache.hadoop.hbase.regionserver.HStore.getLCIndexParameters方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。