Analytics/Monitoring

Analytics

= Analytics Monitoring Points =

Main udp2log instances

 * frontend loggers (varnish, squid)
 * udp2log machines
 * udp2log instance packet loss
 * udp2log multicast relay


 * stat1 + stat1002 archived log rsyncs

Analytics Cluster

 * udp2log instances
 * kafka producers
 * kafka brokers
 * kafka consumers (sorta, maybe)
 * HDFS import directories, filesizes
 * HDFS data loss percentage (via sequence numbers)
 * Hadoop Services

webstatscollector

 * dumps.wikimedia.org (maintained by Ariel (AKA Apergos)?)
 * webstatscollector on gadolinium udp2log

UMAPI

 * tbd

Limn/Reportcard

 * reportcard.wmflabs.org (reportcard.pmtpa.wmflabs)
 * other limn instances (limn0.pmtpa.wmflabs)

XMLDumps

 * dump generation monitor: http://www.infodisiac.com/cgi-bin/WikimediaDownload.pl
 * dump processing monitor: http://stats.wikimedia.org/WikiCountsJobProgress.html