![]() You can obviously still deploy Kafka Minion per clusterĭisclaimer: I am the author of Kafka Minion, and I am still looking for more feedback from other users. Kafka Minion does not support multiple clusters, which reduces complexity in code and as enduser.This is a problem when you want to setup alerts based on consumer group lags Therefore you cannot run it in a HA mode. Burrow has the problem that it will always expose metrics, which will be wrong when it just has started consuming the _consumer_offsets topic. No zookeeper dependency included (which also means that consumers who still commit offsets to zookeeper are not supported).Has additional metrics (such as last commit timestamp for a consumergroup:topic:partition combination, commitrates, info about cleanup policy, you can list all consumer groups for a given topic, etc).Has native prometheus support (no additional deployment necessary to just expose metrics to prometheus).While Kafka Minion internally works similiarly as Burrow (consumes _consumer_offsets topic for Consumer Group Offsets) it has several advantages for your use caseĪdvantages of Kafka Minion over Burrow for your case: Although, I can't find any resources online with up-to-date information on how and where to get that metric My guess is that the metric nsumer does not exist in version 2.2.0 and was replaced with another. Also, this command takes about 25 seconds to execute, making it unreasonable to use as a source for metrics. ![]() I am, however, able to see the data I need by using the following command: bin/kafka-consumer-groups.sh -describe -group benchmark_consumer_group -bootstrap-server localhost:9092Ĭonsumer group 'benchmark_consumer_group' has no active members. Some resources online point to a metric called nsumer, but I have no such metric in my setup. I'm looking for a metric, that gives the offset lag based on topic and groupid. ![]() I have a kafka setup that includes a jmx exporter to prometheus. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |