Analytics/Server Admin Log

August 20

 * 14:02 ottomata: changing group ownership and permissions on raw webrequest data in hdfs. You now must be in the analytics-privatedata-users group to access.

April 17

 * 18:30 ottomata: switching erbium udp2log instance from consuming multicast relay to unicast direct from varnishes

April 2

 * 15:18 ottomata: stopping puppet on stat1

February 3

 * 21:27 ottomata: stopping puppet on cp3021 to test troubleshoot varnishkafka delivery errors with a different change than cp3019

July 25

 * 14:44 ottomata: reinstalled analytics1017 and brought it back up as a new datanode

July 24

 * 20:38 ottomata: taking analytics1017 down for reinstall

July 22

 * 18:44 ottomata: decomissioning analytics1017 datanode in prep for reinstall

May 20

 * 15:54 ottomata: rebooted gadolinium to upgrade linux kernel
 * 14:00 ottomata: stopping hadoop and restarting analytics1010 (namenode) for kernel upgrade

May 16

 * 16:52 ottomata: rebooting stat1 for kernel upgrade
 * 15:47 ottomata: rebooting analytics1027 (hue, oozie, etc.)

May 14

 * 18:42 ottomata: deployed puppet change to make nginx send webrequest logs back to main multicast firehose. NOTE: These logs are not sent to the udp2log instance on emery.
 * 18:02 ottomata: submitted a new webrequest-loss coordinator to work on the webrequest-mobile (geocoded and anonymized) dataset, rather than the soon to be deprecated webrequest-wikipedia-mobile

May 13

 * 18:54 ottomata: analytics1009 now sending geocoded anonymized mobile logs to kafka topic webrequest-mobile, this is consumed to /wmf/raw/webrequest/webrequest-mobile every 15 minutes

April 25

 * 20:44 ottomata: starting hadoop
 * 20:34 ottomata: stopping hadoop to make config changes: mapreduce.task.io.sort.mb 512 -> 200, mapreduce.task.io.sort.factor 100 -> 10, jvm.reuse −1 -> 1

April 18

 * 20:41 ottomata: resourcemanager has not come back online after last restart, working on it...
 * 20:17 ottomata: restarting hadoop to load jar from https://issues.cloudera.org/browse/DISTRO-461

April 12

 * 17:44 ori-l-away: pressing left mouse button + space on stat1

April 10

 * 21:10 andrewbogott: testing logbot on a new host

March 14

 * 00:45 ottomata: upgraded to cdh4 4.2.0 :) :/
 * 00:41 average_drifter: started charting for each feature on stat1 (500M bump related)
 * 00:40 ottomata: restarting hadoop without mapred.job.tracker set to localhost:8021

March 12

 * 23:29 ottomata: restarting hadoop with mapreduce.job.reuse.jvm.num.tasks set to 1

February 2

 * 20:44 milimetric: Limn production build can now be done automatically via coke build && coke bundle

February 1

 * 23:50 andrewbogott: testing number two
 * 23:32 andrewbogott: testing number one

January 31

 * 22:47 ottomata: deployed tab as separator to all frontend cache servers, modified udp2log server filters to DEAL WITH IT!
 * 21:15 drdee: deployed version 0.3.22 of udp-filter on emery, locke and oxygen. This version accept field-delimiter flag.
 * 21:12 ottomata: hiii
 * 17:45 milimetric: Released version 0.6.0 of Limn

January 30

 * 22:33 milimetric: The new version of Limn is now rendering Evan Rosen's awesome dashboard: http://gp-dev.wmflabs.org/

January 28

 * 20:10 ottomata: Modified webrequest-mobile udp2log filters to produce based on frontend server hostname (^cp104[1-4]) rather than m.wikipedia.org domain.

January 27

 * 23:10 drdee: enabled sampling on Thank_You_Main and a country filter on Emery

January 25

 * 16:57 ottomata: now collecting X-CS logs into kraken

January 24

 * 21:55 milimetric: Limn released a new version to dev with bar graph support

January 18

 * 22:37 drdee: yesterday, deployed updated filter for webstatscollector to collect page view counts for wikimediafoundation.org

January 16

 * 15:37 ottomata: deployed new webstatscollector filter to collect stats on wikivoyage domains and restarted udp2log on locke

January 10

 * 15:06 ottomata: restart analytics udp2log instances.  I had to kill all udp2log processes manually before restarting.
 * 14:46 ottomata: stopping udp2log on analytics1005 to investigate
 * 01:56 milimetric: Limn just released a new version to production! Head over to http://reportcard.wmflabs.org/ and check it out.  For a peek at hourly mobile pageview data, check: http://dev-reportcard.wmflabs.org/graphs/pageviews_mobile_hourly

January 4

 * 23:35 milimetric: Limn deployed a new version to dev, now with maps by dschoon: http://dev-reportcard.wmflabs.org/graphs/editors_by_geo

January 2

 * 22:16 ottomata: changed log formats to include Accept-Language and X-Carrier on all frontend cache servers

December 27

 * 14:48 ottomata: rebooting hadoop datanodes with hyperthreading (logical processing) enabled

December 15

 * 01:37 andrewbogott: this is a test of a log message with a link in it like this: http://dev-reportcard.wmflabs.org/

December 14

 * 02:11 drdee: Limn deployed version with data download feature

December 12

 * 22:49 average_drifter: "test123"
 * 22:49 average_drifter: test123
 * 22:49 average_drifter: !log
 * 21:35 andrewbogott: yet another test message
 * 18:01 dschoon: where does this go?

December 11

 * 23:01 milimetric: limn initial log entry
 * 23:00 drdee: kraken initial log entry
 * 21:36 andrewbogott: log test