Can grok_exporter input from kafka?

[william-yang]

my log had put info kafka from many os, how can grok_exporter input from kafka, exporter metrics to promethues?

[william-yang]

1. get info from kafka to logfile , than grok_exporter input from logfile
2. logstash get info from kafka and output to pipeline ,grok_exporter input from stdin.
3. add grok_exporter input from kafka support

which will better?

[fstab]

Hi, the best would of course be to implement a Kafka input for grok_exporter. There was a PR for that once (#16), but nobody is working on it right now. If you know Go programming and would like to contribute, feel free to implement a Kafka input.

However, with the current grok_exporter it might be the best to use the stdin input and pipe the Kafka output to grok_exporter.

[hartfordfive]

Hi @fstab ,

What's the current status with the related PR? Are there any final modifications which need to be done? The only thing I'm wondering is why the sarama Kafka library (authored by Shopify) wasn't used? I haven't done any tests or benchmarks between sarama and optiopay's kafka library, although sarama does have a much more active community and regular updates. It's widely used in many other Go apps which use Kafka. Might it be prudent to use that one instead for those reasons?

[fstab]

replied in #16