Copying offsets of consumer group grp1 to grp2 (Kafka 1.1)
cf. Kafka 0.10: copying offsets of a consumer group to another consumer group in Kafka 0.10 with python script
- status of grp1 (current-offset of each partitions: 3, 4, 3}
~/programs/kafka_2.11-1.1.0$ bin/kafka-consumer-groups.sh --describe --group grp1 --bootstrap-server localhost:9092 Consumer group 'grp1' has no active members. TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID test1 0 3 15 12 - - - test1 1 4 18 14 - - - test1 2 3 17 14 - - -
- status of grp2 (new group)
~/programs/kafka_2.11-1.1.0$ bin/kafka-consumer-groups.sh --describe --group grp2 --bootstrap-server localhost:9092 Error: Consumer group 'grp2' does not exist.
- export offsets of grp1 to csv file(/tmp/grp1-offsets.csv)
~/programs/kafka_2.11-1.1.0$ bin/kafka-consumer-groups.sh --reset-offsets --to-current --export --group grp1 --topic test1 --bootstrap-server localhost:9092 > /tmp/grp1-offsets.csv ~/programs/kafka_2.11-1.1.0$ cat /tmp/grp1-offsets.csv test1,2,3 test1,1,4 test1,0,3
- dry-run
~/programs/kafka_2.11-1.1.0$ bin/kafka-consumer-groups.sh --reset-offsets --from-file /tmp/grp1-offsets.csv --dry-run --group grp2 --topic test1 --bootstrap-server localhost:9092 TOPIC PARTITION NEW-OFFSET test1 2 3 test1 1 4 test1 0 3
- execute
~/programs/kafka_2.11-1.1.0$ bin/kafka-consumer-groups.sh --reset-offsets --from-file /tmp/grp1-offsets.csv --execute --group grp2 --topic test1 --bootstrap-server localhost:9092 TOPIC PARTITION NEW-OFFSET test1 2 3 test1 1 4 test1 0 3
- check
~/programs/kafka_2.11-1.1.0$ bin/kafka-consumer-groups.sh --describe --group grp2 --bootstrap-server localhost:9092 Consumer group 'grp2' has no active members. TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID test1 0 3 15 12 - - - test1 2 3 17 14 - - - test1 1 4 18 14 - - -
last modified 2019-02-24 12:44:51
Processing time 0.0069 sec