本文整理汇总了Java中org.apache.hadoop.mapreduce.lib.join.CompositeInputFormat类的典型用法代码示例。如果您正苦于以下问题：Java CompositeInputFormat类的具体用法？Java CompositeInputFormat怎么用？Java CompositeInputFormat使用的例子？那么, 这里精选的类代码示例或许可以为您提供帮助。
CompositeInputFormat类属于org.apache.hadoop.mapreduce.lib.join包，在下文中一共展示了CompositeInputFormat类的1个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于系统推荐出更棒的Java代码示例。
示例1: run
import org.apache.hadoop.mapreduce.lib.join.CompositeInputFormat; //导入依赖的package包/类
/**
* The MapReduce driver - setup and launch the job.
*
* @param args the command-line arguments
* @return the process exit code
* @throws Exception if something goes wrong
*/
public int run(final String[] args) throws Exception {
Cli cli = Cli.builder().setArgs(args).addOptions(Options.values()).build();
int result = cli.runCmd();
if (result != 0) {
return result;
}
Path usersPath = new Path(cli.getArgValueAsString(Options.USERS));
Path userLogsPath = new Path(cli.getArgValueAsString(Options.USER_LOGS));
Path outputPath = new Path(cli.getArgValueAsString(Options.OUTPUT));
Configuration conf = super.getConf();
Job job = new Job(conf);
job.setJarByClass(CompositeJoin.class);
job.setMapperClass(JoinMap.class);
job.setInputFormatClass(CompositeInputFormat.class);
job.getConfiguration().set(CompositeInputFormat.JOIN_EXPR,
CompositeInputFormat.compose("inner",
KeyValueTextInputFormat.class, usersPath, userLogsPath)
);
job.setNumReduceTasks(0);
FileInputFormat.setInputPaths(job, userLogsPath);
FileOutputFormat.setOutputPath(job, outputPath);
return job.waitForCompletion(true) ? 0 : 1;
}