Analytics/Server Admin Log

December 4

 * 22:53 qchris: Monkey patched 2014-12-04T21.51.53Z--115f510 and "current" deployment of refinery to not add refinery-hive.jar to oozie's hive config (See )
 * 21:53 qchris: deployed refinery 115f510
 * 15:00 qchris: Deduped webrequest Hive partitions for 2014-12-03T17/1H

December 3

 * 16:48 ottomata: starting upgrade of analytics1027 to trusty, hive and oozie are offline for a bit

December 2

 * 20:11 ottomata: killed oozie bundle webrequest-monitor_done_flag-bundle

November 30

 * 23:45 qchris: restarted EventLogging's graphite consumer on hafnium. It was hanging and did no longer report numbers.
 * 22:31 qchris: Marked raw bits webrequest partition for 2014-11-28T18/2H ok (See https://phabricator.wikimedia.org/T71615#795650 )
 * 22:31 qchris: Marked raw bits webrequest partition for 2014-11-28T07/2H ok (See https://phabricator.wikimedia.org/T71615#795650 )

November 19

 * 13:09 qchris: Marked raw upload webrequest partition for 2014-11-18T20/1H ok (See, and )
 * 13:08 qchris: Marked raw text webrequest partition for 2014-11-18T19/2H ok (See )
 * 13:08 qchris: Marked raw mobile webrequest partition for 2014-11-18T20/1H ok (See )
 * 13:08 qchris: Marked raw bits webrequest partition for 2014-11-18T19/2H ok (See )

November 10

 * 16:00 qchris: Marked raw upload webrequest partition for 2014-11-10T10/2H ok (See )
 * 15:01 qchris: Marked raw upload webrequest partition for 2014-11-09T22/2H ok (See )

November 8

 * 21:24 qchris: Marked raw text webrequest partitions for 2014-11-08T12/2H ok (See )
 * 21:15 qchris: Marked raw text webrequest partition for 2014-11-07T14/1H ok (See )
 * 20:55 qchris: Marked raw bits webrequest partitions for 2014-11-08T00/2H ok (See )

November 7

 * 12:03 qchris: Marked all 4 raw webrequest partition for 2014-11-06T21/1H ok (See )

November 6

 * 21:18 qchris: Rebuilt webrequest table, since changing the time_firstbyte from float to double broke it (See )
 * 20:50 qchris: Added range column to webrequest table (See )
 * 20:49 qchris: Switched webrequest's time_firstbyte from float to double (See )
 * 10:57 qchris: Marked raw bits webrequest partition for 2014-11-05T14/2H ok (See )

October 31

 * 12:57 qchris: Marked raw bits webrequest partition for 2014-10-30T21/1H ok (See )
 * 12:57 qchris: Marked raw upload webrequest partition for 2014-10-30T21/1H ok (See )

October 30

 * 10:12 qchris: Marked raw upload webrequest partition for 2014-10-29T14/1H ok (See )

October 29

 * 17:31 qchris: Marked raw bits webrequest partition for 2014-10-29T09/1H ok (See )
 * 17:31 qchris: Marked raw bits webrequest partition for 2014-10-29T08/1H ok (See )
 * 17:14 qchris: Marked raw upload webrequest partition for 2014-10-28T19/1H ok (See )
 * 17:14 qchris: Marked raw bits webrequest partition for 2014-10-28T19/1H ok (See )
 * 15:19 qchris_away: Marked raw upload webrequest partition for 2014-10-29T01/2H ok (See )

October 28

 * 21:52 qchris: Marked the 3 raw text webrequest partitions for 2014-10-27T15/3H ok (See )
 * 21:34 qchris: Marked raw upload webrequest partition for 2014-10-27T07/1H ok (See )
 * 21:34 qchris: Marked raw text webrequest partition for 2014-10-27T07/1H ok (See )
 * 19:54 qchris: Ran kafka leader re-elections, since analytics1021 got kicked out of being partition leader (See )

October 27

 * 07:23 qchris: Marked raw bits webrequest partitions for 2014-10-24T19/2H ok

October 24

 * 09:42 qchris: Marked raw bits webrequest partition for 2014-10-23T14/1H ok (See )

October 23

 * 14:58 qchris: Marked raw text webrequest partitions for 2014-10-22T23/1H ok (See )
 * 14:58 qchris: Marked raw text webrequest partitions for 2014-10-22T15/1H ok (See )

October 22

 * 12:07 qchris: Marked raw bits webrequest partitions for 2014-10-22T06/2H ok (See )
 * 11:04 qchris: Marked upload webrequest partitions for 2014-10-21T14/2H ok (See )
 * 11:01 qchris: Marked bits and mobile webrequest partitions for 2014-10-21T13/2H ok (See )
 * 11:00 qchris: Marked webrequest partitions for 2014-10-21T11/1H ok (See )

October 21

 * 14:28 ottomata: set vm.dirty_writeback_centisecs = 200 (was 500) on analytics1021 (see also: https://bugzilla.wikimedia.org/show_bug.cgi?id=69667)
 * 11:28 qchris: Marked webrequest partitions for 2014-10-20T13/1H good

October 20

 * 22:45 qchris: Marked webrequest partitions for 2014-10-20T02/1H good
 * 10:38 qchris: Ran kafka leader re-election. See.

October 15

 * 20:59 qchris: deployed refinery ae72e8952b8c776c5cb298b833129f78e662595a to hdfs

October 14

 * 11:52 qchris: Marked webrequest partitions for 2014-10-13T13:xx:xx good
 * 10:51 qchris: Ran kafka leader re-elections, since analytics1021 got kicked out of being partition leader.

October 11

 * 11:23 qchris: Marked upload webrequest partitions for 2014-10-10T15:xx:xx good

October 9

 * 13:33 qchris: Marked bits, text, and upload webrequest partitions for 2014-10-08T23:xx:xx ok

September 30

 * 11:45 qchris: Marking webrequest partitions for 2014-09-29T20:xx:xx good

August 28

 * 16:00 ottomata: restarted webstats-collector on gadolinium
 * 15:20 qchris: yesterday (while the bot was not working), webstatscollector on gadolinium has been restarted twice (see http://bots.wmflabs.org/~wm-bot/logs/%23wikimedia-analytics/20140827.txt )

August 20

 * 14:02 ottomata: changing group ownership and permissions on raw webrequest data in hdfs. You now must be in the analytics-privatedata-users group to access.

April 17

 * 18:30 ottomata: switching erbium udp2log instance from consuming multicast relay to unicast direct from varnishes

April 2

 * 15:18 ottomata: stopping puppet on stat1

February 3

 * 21:27 ottomata: stopping puppet on cp3021 to test troubleshoot varnishkafka delivery errors with a different change than cp3019