本文整理汇总了Python中kafka.KafkaConsumer.max_buffer_size方法的典型用法代码示例。如果您正苦于以下问题：Python KafkaConsumer.max_buffer_size方法的具体用法？Python KafkaConsumer.max_buffer_size怎么用？Python KafkaConsumer.max_buffer_size使用的例子？那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在类kafka.KafkaConsumer的用法示例。
在下文中一共展示了KafkaConsumer.max_buffer_size方法的1个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于系统推荐出更棒的Python代码示例。
示例1: len
# 需要导入模块: from kafka import KafkaConsumer [as 别名]
# 或者: from kafka.KafkaConsumer import max_buffer_size [as 别名]
import avro.io
import io
import time
from confluent.schemaregistry.client import CachedSchemaRegistryClient
from confluent.schemaregistry.serializers import MessageSerializer
from sys import argv
from config import KAFKA_URL, SCHEMA_REGISTRY_URL
topic = argv[1] #enter topic as parameter when running script
if len(argv) > 2 and argv[2] == 'reset':
auto_offset_reset = 'smallest'
else:
auto_offset_reset = 'largest'
schema_registry_client = CachedSchemaRegistryClient(url=SCHEMA_REGISTRY_URL)
serializer = MessageSerializer(schema_registry_client)
# simple decode to replace Kafka-streaming's built-in decode decoding UTF8 ()
def decoder(s):
decoded_message = serializer.decode_message(s)
return decoded_message
timestamp = time.time()
consumer = KafkaConsumer(topic, "sample-group-"+str(timestamp), bootstrap_servers=[KAFKA_URL], auto_offset_reset=auto_offset_reset)
consumer.max_buffer_size=0
for message in consumer:
decoded_message = decoder(message.value)
print message.offset
print decoded_message