當前位置: 首頁>>代碼示例>>Java>>正文


Java DataStream.broadcast方法代碼示例

本文整理匯總了Java中org.apache.flink.streaming.api.datastream.DataStream.broadcast方法的典型用法代碼示例。如果您正苦於以下問題:Java DataStream.broadcast方法的具體用法?Java DataStream.broadcast怎麽用?Java DataStream.broadcast使用的例子?那麽, 這裏精選的方法代碼示例或許可以為您提供幫助。您也可以進一步了解該方法所在org.apache.flink.streaming.api.datastream.DataStream的用法示例。


在下文中一共展示了DataStream.broadcast方法的1個代碼示例,這些例子默認根據受歡迎程度排序。您可以為喜歡或者感覺有用的代碼點讚,您的評價將有助於係統推薦出更棒的Java代碼示例。

示例1: processInput

import org.apache.flink.streaming.api.datastream.DataStream; //導入方法依賴的package包/類
private DataStream<Tuple> processInput(String boltId, IRichBolt userBolt,
		GlobalStreamId streamId, Grouping grouping,
		Map<String, DataStream<Tuple>> producer) {

	assert (userBolt != null);
	assert (boltId != null);
	assert (streamId != null);
	assert (grouping != null);
	assert (producer != null);

	final String producerId = streamId.get_componentId();
	final String inputStreamId = streamId.get_streamId();

	DataStream<Tuple> inputStream = producer.get(inputStreamId);

	final FlinkOutputFieldsDeclarer declarer = new FlinkOutputFieldsDeclarer();
	declarers.put(boltId, declarer);
	userBolt.declareOutputFields(declarer);
	this.outputStreams.put(boltId, declarer.outputStreams);

	// if producer was processed already
	if (grouping.is_set_shuffle()) {
		// Storm uses a round-robin shuffle strategy
		inputStream = inputStream.rebalance();
	} else if (grouping.is_set_fields()) {
		// global grouping is emulated in Storm via an empty fields grouping list
		final List<String> fields = grouping.get_fields();
		if (fields.size() > 0) {
			FlinkOutputFieldsDeclarer prodDeclarer = this.declarers.get(producerId);
			inputStream = inputStream.keyBy(prodDeclarer
					.getGroupingFieldIndexes(inputStreamId,
							grouping.get_fields()));
		} else {
			inputStream = inputStream.global();
		}
	} else if (grouping.is_set_all()) {
		inputStream = inputStream.broadcast();
	} else if (!grouping.is_set_local_or_shuffle()) {
		throw new UnsupportedOperationException(
				"Flink only supports (local-or-)shuffle, fields, all, and global grouping");
	}

	return inputStream;
}
 
開發者ID:axbaretto,項目名稱:flink,代碼行數:45,代碼來源:FlinkTopology.java


注:本文中的org.apache.flink.streaming.api.datastream.DataStream.broadcast方法示例由純淨天空整理自Github/MSDocs等開源代碼及文檔管理平台,相關代碼片段篩選自各路編程大神貢獻的開源項目,源碼版權歸原作者所有,傳播和使用請參考對應項目的License;未經允許,請勿轉載。