当前位置: 首页>>代码示例>>Java>>正文


Java DataStream.broadcast方法代码示例

本文整理汇总了Java中org.apache.flink.streaming.api.datastream.DataStream.broadcast方法的典型用法代码示例。如果您正苦于以下问题:Java DataStream.broadcast方法的具体用法?Java DataStream.broadcast怎么用?Java DataStream.broadcast使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.flink.streaming.api.datastream.DataStream的用法示例。


在下文中一共展示了DataStream.broadcast方法的1个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: processInput

import org.apache.flink.streaming.api.datastream.DataStream; //导入方法依赖的package包/类
private DataStream<Tuple> processInput(String boltId, IRichBolt userBolt,
		GlobalStreamId streamId, Grouping grouping,
		Map<String, DataStream<Tuple>> producer) {

	assert (userBolt != null);
	assert (boltId != null);
	assert (streamId != null);
	assert (grouping != null);
	assert (producer != null);

	final String producerId = streamId.get_componentId();
	final String inputStreamId = streamId.get_streamId();

	DataStream<Tuple> inputStream = producer.get(inputStreamId);

	final FlinkOutputFieldsDeclarer declarer = new FlinkOutputFieldsDeclarer();
	declarers.put(boltId, declarer);
	userBolt.declareOutputFields(declarer);
	this.outputStreams.put(boltId, declarer.outputStreams);

	// if producer was processed already
	if (grouping.is_set_shuffle()) {
		// Storm uses a round-robin shuffle strategy
		inputStream = inputStream.rebalance();
	} else if (grouping.is_set_fields()) {
		// global grouping is emulated in Storm via an empty fields grouping list
		final List<String> fields = grouping.get_fields();
		if (fields.size() > 0) {
			FlinkOutputFieldsDeclarer prodDeclarer = this.declarers.get(producerId);
			inputStream = inputStream.keyBy(prodDeclarer
					.getGroupingFieldIndexes(inputStreamId,
							grouping.get_fields()));
		} else {
			inputStream = inputStream.global();
		}
	} else if (grouping.is_set_all()) {
		inputStream = inputStream.broadcast();
	} else if (!grouping.is_set_local_or_shuffle()) {
		throw new UnsupportedOperationException(
				"Flink only supports (local-or-)shuffle, fields, all, and global grouping");
	}

	return inputStream;
}
 
开发者ID:axbaretto,项目名称:flink,代码行数:45,代码来源:FlinkTopology.java


注:本文中的org.apache.flink.streaming.api.datastream.DataStream.broadcast方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。