本文整理汇总了Java中org.apache.hadoop.fs.FileUtil.copyMerge方法的典型用法代码示例。如果您正苦于以下问题:Java FileUtil.copyMerge方法的具体用法?Java FileUtil.copyMerge怎么用?Java FileUtil.copyMerge使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在类org.apache.hadoop.fs.FileUtil
的用法示例。
在下文中一共展示了FileUtil.copyMerge方法的1个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。
示例1: run
import org.apache.hadoop.fs.FileUtil; //导入方法依赖的package包/类
/**
*
* @return result - Frobenius Norm
* @throws IOException
* @throws ClassNotFoundException
* @throws InterruptedException
*/
public Double run() throws IOException, ClassNotFoundException, InterruptedException {
String wd = configuration.get("wd");
Path wdPath = new Path(wd);
Job job = Job.getInstance(configuration, "DF1");
Path tmpPath = new Path(configuration.get("wd"), "dftmp");
job.setJarByClass(MRNMF.class);
FileInputFormat.addInputPath(job, new Path(Xpath));
MatrixUpdater.addInpuPath(job, new Path(FGPath));
FileOutputFormat.setOutputPath(job, tmpPath);
job.setInputFormatClass(TextInputFormat.class);
job.setOutputFormatClass(TextOutputFormat.class);
job.setMapOutputKeyClass(LongWritable.class);
job.setMapOutputValueClass(Text.class);
job.setMapperClass(DFMapper1.class);
job.setReducerClass(DFReducer1.class);
job.waitForCompletion(true);
job = Job.getInstance(configuration, "DF2");
job.setJarByClass(MRNMF.class);
MatrixUpdater.addInpuPath(job, tmpPath);
FileOutputFormat.setOutputPath(job, new Path(wdPath, outputDir));
job.setInputFormatClass(TextInputFormat.class);
job.setOutputFormatClass(TextOutputFormat.class);
job.setMapOutputKeyClass(LongWritable.class);
job.setMapOutputValueClass(Text.class);
job.setMapperClass(DFMapper2.class);
job.setReducerClass(DFReducer2.class);
job.waitForCompletion(true);
FileSystem wdfs = wdPath.getFileSystem(new Configuration());
FileUtil.copyMerge(wdfs, new Path(wd, outputDir), wdfs, new Path(wd, resultFileName), false, new Configuration(), "");
return getResult(wdfs, new Path(wd, resultFileName));
}