本文整理汇总了Java中org.apache.hadoop.mapreduce.split.JobSplit.TaskSplitMetaInfo.getLocations方法的典型用法代码示例。如果您正苦于以下问题:Java TaskSplitMetaInfo.getLocations方法的具体用法?Java TaskSplitMetaInfo.getLocations怎么用?Java TaskSplitMetaInfo.getLocations使用的例子?那么, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在类org.apache.hadoop.mapreduce.split.JobSplit.TaskSplitMetaInfo
的用法示例。
在下文中一共展示了TaskSplitMetaInfo.getLocations方法的2个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。
示例1: SplitInfo
import org.apache.hadoop.mapreduce.split.JobSplit.TaskSplitMetaInfo; //导入方法依赖的package包/类
SplitInfo(TaskSplitMetaInfo taskSplitMetaInfo,String []topologyPath){
this.taskSplitMetaInfo = taskSplitMetaInfo;
this.length = taskSplitMetaInfo.getInputDataLength();
this.hosts = taskSplitMetaInfo.getLocations();
assert(hosts.length==topologyPath.length||topologyPath.length==0);
//if this fs does not have any rack information,use default rack
if(topologyPath==null||topologyPath.length==0){
topologyPath = new String[hosts.length];
for(int i=0;i<hosts.length;i++){
topologyPath[i]=(new NodeBase(hosts[i],NetworkTopology.DEFAULT_RACK)).toString();
}
}
//the topology pahts have the host name as the last component,strip it
this.racks = new String[hosts.length];
for(int i=0;i<racks.length;i++){
this.racks[i]=(new NodeBase(topologyPath[i])).getNetworkLocation();
}
}
示例2: MapTaskAttemptImpl
import org.apache.hadoop.mapreduce.split.JobSplit.TaskSplitMetaInfo; //导入方法依赖的package包/类
public MapTaskAttemptImpl(TaskId taskId, int attempt,
EventHandler eventHandler, Path jobFile,
int partition, TaskSplitMetaInfo splitInfo, JobConf conf,
TaskAttemptListener taskAttemptListener,
Token<JobTokenIdentifier> jobToken,
Credentials credentials, Clock clock,
AppContext appContext) {
super(taskId, attempt, eventHandler,
taskAttemptListener, jobFile, partition, conf, splitInfo.getLocations(),
jobToken, credentials, clock, appContext);
this.splitInfo = splitInfo;
}