当前位置: 首页>>代码示例>>Java>>正文


Java ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN属性代码示例

本文整理汇总了Java中org.apache.flink.configuration.ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN属性的典型用法代码示例。如果您正苦于以下问题:Java ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN属性的具体用法?Java ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN怎么用?Java ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN使用的例子?那么恭喜您, 这里精选的属性代码示例或许可以为您提供帮助。您也可以进一步了解该属性所在org.apache.flink.configuration.ConfigConstants的用法示例。


在下文中一共展示了ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN属性的1个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: loadConfigParameters

protected static void loadConfigParameters(Configuration parameters) {
	int maxSamples = parameters.getInteger(ConfigConstants.DELIMITED_FORMAT_MAX_LINE_SAMPLES_KEY,
			ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_LINE_SAMPLES);
	int minSamples = parameters.getInteger(ConfigConstants.DELIMITED_FORMAT_MIN_LINE_SAMPLES_KEY,
		ConfigConstants.DEFAULT_DELIMITED_FORMAT_MIN_LINE_SAMPLES);
	
	if (maxSamples < 0) {
		LOG.error("Invalid default maximum number of line samples: " + maxSamples + ". Using default value of " +
			ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_LINE_SAMPLES);
		maxSamples = ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_LINE_SAMPLES;
	}
	if (minSamples < 0) {
		LOG.error("Invalid default minimum number of line samples: " + minSamples + ". Using default value of " +
			ConfigConstants.DEFAULT_DELIMITED_FORMAT_MIN_LINE_SAMPLES);
		minSamples = ConfigConstants.DEFAULT_DELIMITED_FORMAT_MIN_LINE_SAMPLES;
	}
	
	DEFAULT_MAX_NUM_SAMPLES = maxSamples;
	
	if (minSamples > maxSamples) {
		LOG.error("Defaul minimum number of line samples cannot be greater the default maximum number " +
				"of line samples: min=" + minSamples + ", max=" + maxSamples + ". Defaulting minumum to maximum.");
		DEFAULT_MIN_NUM_SAMPLES = maxSamples;
	} else {
		DEFAULT_MIN_NUM_SAMPLES = minSamples;
	}
	
	int maxLen = parameters.getInteger(ConfigConstants.DELIMITED_FORMAT_MAX_SAMPLE_LENGTH_KEY,
			ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN);
	if (maxLen <= 0) {
		maxLen = ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN;
		LOG.error("Invalid value for the maximum sample record length. Using defailt value of " + maxLen + '.');
	} else if (maxLen < DEFAULT_READ_BUFFER_SIZE) {
		maxLen = DEFAULT_READ_BUFFER_SIZE;
		LOG.warn("Increasing maximum sample record length to size of the read buffer (" + maxLen + ").");
	}
	MAX_SAMPLE_LEN = maxLen;
}
 
开发者ID:axbaretto,项目名称:flink,代码行数:38,代码来源:DelimitedInputFormat.java


注:本文中的org.apache.flink.configuration.ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN属性示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。