Kafka Consumer API not subscribing using Java client

Question

Kafka: 0.10.1.0 (Client & Server) Java client. Zookeeper: 3.4.6

Setup: Producer publishes messages. Sent messages on topic counted using ./kafka-run-class.sh kafka.tools.GetOffsetShell --broker-list localhost:9093 --topic TEST.TOPIC --time -1

Issue Consumer when polled while subscribing doesn't work but if you manually assign() - it works. There had been a separate thread on same question but no answer. It may be UUID issue but need more details as we are in evaluating phase and details would help.

Consumer Settings: props.put("bootstrap.servers", servers); props.put("enable.auto.commit", ENABLE_AUTO_COMMIT);

    props.put("auto.commit.interval.ms", AUTO_COMMIT_INTERVAL_MS);
    props.put("session.timeout.ms", SESSION_TIMEOUT_MS);
    props.put("group.id", CONSUMER_GROUP_ID);
    props.put("key.deserializer", STRING_DESRIALIZER);
    props.put("value.deserializer", STRING_DESRIALIZER);
    props.put("auto.offset.reset", "earliest");

are you using the command line consumer? can you share the consumer configurations? — daniel
– daniel, Commented May 11, 2017 at 17:11
updated. I am using Java client (KafkaConsumer). When I use subscribe(topics) - doesn't work. assign(topicPartitions) - Works. — amit.shipra
– amit.shipra, Commented May 11, 2017 at 17:34
do you have the following property set in kafka properties? etc/kafka/server.properties usually. listeners=PLAINTEXT://<ip>:<port> This tells kafka to listen for consumers here in plaintext (vs ssl). — daniel
– daniel, Commented May 11, 2017 at 17:39

amit.shipra · Accepted Answer · 2017-06-09 19:15:55Z

0

Issue was with Version of Kafka.

Switched to 0.10.2.1 (server and client) and subscribe() worked flawlessly.

answered Jun 9, 2017 at 19:15

amit.shipra

1971 gold badge2 silver badges16 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Kafka Consumer API not subscribing using Java client

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related