当前位置: 首页>>代码示例>>Java>>正文


Java TaskSplitMetaInfo.getLocations方法代码示例

本文整理汇总了Java中org.apache.hadoop.mapreduce.split.JobSplit.TaskSplitMetaInfo.getLocations方法的典型用法代码示例。如果您正苦于以下问题:Java TaskSplitMetaInfo.getLocations方法的具体用法?Java TaskSplitMetaInfo.getLocations怎么用?Java TaskSplitMetaInfo.getLocations使用的例子?那么, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.hadoop.mapreduce.split.JobSplit.TaskSplitMetaInfo的用法示例。


在下文中一共展示了TaskSplitMetaInfo.getLocations方法的2个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: SplitInfo

import org.apache.hadoop.mapreduce.split.JobSplit.TaskSplitMetaInfo; //导入方法依赖的package包/类
SplitInfo(TaskSplitMetaInfo taskSplitMetaInfo,String []topologyPath){
		
	this.taskSplitMetaInfo = taskSplitMetaInfo;
	this.length = taskSplitMetaInfo.getInputDataLength();
	this.hosts  = taskSplitMetaInfo.getLocations();
	
	assert(hosts.length==topologyPath.length||topologyPath.length==0);
	
	//if this fs does not have any rack information,use default rack
	if(topologyPath==null||topologyPath.length==0){
	  topologyPath = new String[hosts.length];	
	 	for(int i=0;i<hosts.length;i++){
	 		topologyPath[i]=(new NodeBase(hosts[i],NetworkTopology.DEFAULT_RACK)).toString();
	 	}	
	}
	
	//the topology pahts have the host name as the last component,strip it
	this.racks = new String[hosts.length];
	for(int i=0;i<racks.length;i++){
		
		this.racks[i]=(new NodeBase(topologyPath[i])).getNetworkLocation();
	}
	
}
 
开发者ID:yncxcw,项目名称:FlexMap,代码行数:25,代码来源:TaskDataProvision.java

示例2: MapTaskAttemptImpl

import org.apache.hadoop.mapreduce.split.JobSplit.TaskSplitMetaInfo; //导入方法依赖的package包/类
public MapTaskAttemptImpl(TaskId taskId, int attempt, 
    EventHandler eventHandler, Path jobFile, 
    int partition, TaskSplitMetaInfo splitInfo, JobConf conf,
    TaskAttemptListener taskAttemptListener, 
    Token<JobTokenIdentifier> jobToken,
    Credentials credentials, Clock clock,
    AppContext appContext) {
  super(taskId, attempt, eventHandler, 
      taskAttemptListener, jobFile, partition, conf, splitInfo.getLocations(),
      jobToken, credentials, clock, appContext);
  this.splitInfo = splitInfo;
}
 
开发者ID:naver,项目名称:hadoop,代码行数:13,代码来源:MapTaskAttemptImpl.java


注:本文中的org.apache.hadoop.mapreduce.split.JobSplit.TaskSplitMetaInfo.getLocations方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。