本文整理汇总了Java中org.apache.flink.configuration.ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN属性的典型用法代码示例。如果您正苦于以下问题:Java ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN属性的具体用法?Java ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN怎么用?Java ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN使用的例子?那么恭喜您, 这里精选的属性代码示例或许可以为您提供帮助。您也可以进一步了解该属性所在类org.apache.flink.configuration.ConfigConstants
的用法示例。
在下文中一共展示了ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN属性的1个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。
示例1: loadConfigParameters
protected static void loadConfigParameters(Configuration parameters) {
int maxSamples = parameters.getInteger(ConfigConstants.DELIMITED_FORMAT_MAX_LINE_SAMPLES_KEY,
ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_LINE_SAMPLES);
int minSamples = parameters.getInteger(ConfigConstants.DELIMITED_FORMAT_MIN_LINE_SAMPLES_KEY,
ConfigConstants.DEFAULT_DELIMITED_FORMAT_MIN_LINE_SAMPLES);
if (maxSamples < 0) {
LOG.error("Invalid default maximum number of line samples: " + maxSamples + ". Using default value of " +
ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_LINE_SAMPLES);
maxSamples = ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_LINE_SAMPLES;
}
if (minSamples < 0) {
LOG.error("Invalid default minimum number of line samples: " + minSamples + ". Using default value of " +
ConfigConstants.DEFAULT_DELIMITED_FORMAT_MIN_LINE_SAMPLES);
minSamples = ConfigConstants.DEFAULT_DELIMITED_FORMAT_MIN_LINE_SAMPLES;
}
DEFAULT_MAX_NUM_SAMPLES = maxSamples;
if (minSamples > maxSamples) {
LOG.error("Defaul minimum number of line samples cannot be greater the default maximum number " +
"of line samples: min=" + minSamples + ", max=" + maxSamples + ". Defaulting minumum to maximum.");
DEFAULT_MIN_NUM_SAMPLES = maxSamples;
} else {
DEFAULT_MIN_NUM_SAMPLES = minSamples;
}
int maxLen = parameters.getInteger(ConfigConstants.DELIMITED_FORMAT_MAX_SAMPLE_LENGTH_KEY,
ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN);
if (maxLen <= 0) {
maxLen = ConfigConstants.DEFAULT_DELIMITED_FORMAT_MAX_SAMPLE_LEN;
LOG.error("Invalid value for the maximum sample record length. Using defailt value of " + maxLen + '.');
} else if (maxLen < DEFAULT_READ_BUFFER_SIZE) {
maxLen = DEFAULT_READ_BUFFER_SIZE;
LOG.warn("Increasing maximum sample record length to size of the read buffer (" + maxLen + ").");
}
MAX_SAMPLE_LEN = maxLen;
}