当前位置: 首页>>代码示例>>Java>>正文


Java BlockProto.getNumBytes方法代码示例

本文整理汇总了Java中org.apache.hadoop.hdfs.protocol.proto.HdfsProtos.BlockProto.getNumBytes方法的典型用法代码示例。如果您正苦于以下问题:Java BlockProto.getNumBytes方法的具体用法?Java BlockProto.getNumBytes怎么用?Java BlockProto.getNumBytes使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.hadoop.hdfs.protocol.proto.HdfsProtos.BlockProto的用法示例。


在下文中一共展示了BlockProto.getNumBytes方法的5个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: initReplicaRecovery

import org.apache.hadoop.hdfs.protocol.proto.HdfsProtos.BlockProto; //导入方法依赖的package包/类
@Override
public ReplicaRecoveryInfo initReplicaRecovery(RecoveringBlock rBlock)
    throws IOException {
  InitReplicaRecoveryRequestProto req = InitReplicaRecoveryRequestProto
      .newBuilder().setBlock(PBHelper.convert(rBlock)).build();
  InitReplicaRecoveryResponseProto resp;
  try {
    resp = rpcProxy.initReplicaRecovery(NULL_CONTROLLER, req);
  } catch (ServiceException e) {
    throw ProtobufHelper.getRemoteException(e);
  }
  if (!resp.getReplicaFound()) {
    // No replica found on the remote node.
    return null;
  } else {
    if (!resp.hasBlock() || !resp.hasState()) {
      throw new IOException("Replica was found but missing fields. " +
          "Req: " + req + "\n" +
          "Resp: " + resp);
    }
  }
  
  BlockProto b = resp.getBlock();
  return new ReplicaRecoveryInfo(b.getBlockId(), b.getNumBytes(),
      b.getGenStamp(), PBHelper.convert(resp.getState()));
}
 
开发者ID:naver,项目名称:hadoop,代码行数:27,代码来源:InterDatanodeProtocolTranslatorPB.java

示例2: run

import org.apache.hadoop.hdfs.protocol.proto.HdfsProtos.BlockProto; //导入方法依赖的package包/类
private void run(InputStream in) throws IOException {
  INodeSection s = INodeSection.parseDelimitedFrom(in);
  for (int i = 0; i < s.getNumInodes(); ++i) {
    INodeSection.INode p = INodeSection.INode.parseDelimitedFrom(in);
    if (p.getType() == INodeSection.INode.Type.FILE) {
      ++totalFiles;
      INodeSection.INodeFile f = p.getFile();
      totalBlocks += f.getBlocksCount();
      long fileSize = 0;
      for (BlockProto b : f.getBlocksList()) {
        fileSize += b.getNumBytes();
      }
      maxFileSize = Math.max(fileSize, maxFileSize);
      totalSpace += fileSize * f.getReplication();

      int bucket = fileSize > maxSize ? distribution.length - 1 : (int) Math
          .ceil((double)fileSize / steps);
      ++distribution[bucket];

    } else if (p.getType() == INodeSection.INode.Type.DIRECTORY) {
      ++totalDirectories;
    }

    if (i % (1 << 20) == 0) {
      out.println("Processed " + i + " inodes.");
    }
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:29,代码来源:FileDistributionCalculator.java

示例3: initReplicaRecovery

import org.apache.hadoop.hdfs.protocol.proto.HdfsProtos.BlockProto; //导入方法依赖的package包/类
@Override
public ReplicaRecoveryInfo initReplicaRecovery(RecoveringBlock rBlock)
    throws IOException {
  InitReplicaRecoveryRequestProto req =
      InitReplicaRecoveryRequestProto.newBuilder()
          .setBlock(PBHelper.convert(rBlock)).build();
  InitReplicaRecoveryResponseProto resp;
  try {
    resp = rpcProxy.initReplicaRecovery(NULL_CONTROLLER, req);
  } catch (ServiceException e) {
    throw ProtobufHelper.getRemoteException(e);
  }
  if (!resp.getReplicaFound()) {
    // No replica found on the remote node.
    return null;
  } else {
    if (!resp.hasBlock() || !resp.hasState()) {
      throw new IOException("Replica was found but missing fields. " +
          "Req: " + req + "\n" +
          "Resp: " + resp);
    }
  }
  
  BlockProto b = resp.getBlock();
  return new ReplicaRecoveryInfo(b.getBlockId(), b.getNumBytes(),
      b.getGenStamp(), PBHelper.convert(resp.getState()));
}
 
开发者ID:hopshadoop,项目名称:hops,代码行数:28,代码来源:InterDatanodeProtocolTranslatorPB.java

示例4: getFileSize

import org.apache.hadoop.hdfs.protocol.proto.HdfsProtos.BlockProto; //导入方法依赖的package包/类
private long getFileSize(INodeFile f) {
  long size = 0;
  for (BlockProto p : f.getBlocksList()) {
    size += p.getNumBytes();
  }
  return size;
}
 
开发者ID:Seagate,项目名称:hadoop-on-lustre2,代码行数:8,代码来源:LsrPBImage.java

示例5: convert

import org.apache.hadoop.hdfs.protocol.proto.HdfsProtos.BlockProto; //导入方法依赖的package包/类
public static Block convert(BlockProto b) {
  return new Block(b.getBlockId(), b.getNumBytes(), b.getGenStamp());
}
 
开发者ID:naver,项目名称:hadoop,代码行数:4,代码来源:PBHelper.java


注:本文中的org.apache.hadoop.hdfs.protocol.proto.HdfsProtos.BlockProto.getNumBytes方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。