本文整理汇总了Java中org.apache.hadoop.mapred.MultiFileSplit.getPaths方法的典型用法代码示例。如果您正苦于以下问题:Java MultiFileSplit.getPaths方法的具体用法?Java MultiFileSplit.getPaths怎么用?Java MultiFileSplit.getPaths使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在类org.apache.hadoop.mapred.MultiFileSplit
的用法示例。
在下文中一共展示了MultiFileSplit.getPaths方法的2个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。
示例1: MultiFileLineRecordReader
import org.apache.hadoop.mapred.MultiFileSplit; //导入方法依赖的package包/类
public MultiFileLineRecordReader(Configuration conf, MultiFileSplit split)
throws IOException {
this.split = split;
fs = FileSystem.get(conf);
this.paths = split.getPaths();
this.totLength = split.getLength();
this.offset = 0;
//open the first file
Path file = paths[count];
currentStream = fs.open(file);
currentReader = new BufferedReader(new InputStreamReader(currentStream));
}
示例2: MultiFileLineRecordReader
import org.apache.hadoop.mapred.MultiFileSplit; //导入方法依赖的package包/类
public MultiFileLineRecordReader(Configuration conf, MultiFileSplit split)
throws IOException {
this.split = split;
fs = FileSystem.get(conf);
this.paths = split.getPaths();
this.totLength = split.getLength();
this.offset = 0;
//open the first file
Path file = paths[count];
currentStream = fs.open(file);
currentReader = new BufferedReader(new InputStreamReader(currentStream));
}