< Reading‎ | Web
Jump to navigation Jump to search

This records the current state of chores as defined in the chore list. View team norms.

Chore Status Notes Last updated
Who's on chore duty next? ✅ Olga Niedzielski (talk) 14:28, 21 May 2020 (UTC)
Schedule/OOO ✅ Sam OOO (TBC)

Nick OOO May 29 & June 1

Stephen in performance training (unavailable) 11am to 2:30pm Jun 1-Jun 5

Niedzielski (talk) 02:30, 26 May 2020 (UTC)
Browser tests ✅ 😎 Niedzielski (talk) 14:28, 21 May 2020 (UTC)
Logstash ⚠️

Lots of deprecation warning related to below

New Wikivoyage production error relating to recent Vector work -

A few `Uncaught Error: Call to a member function isLocal() on boolean` tracked in T250767 and lots of infobox errors.

There was a lot of noise so spent most of my time filtering out irrelevant noise (citoid, abuse filter). I also added Vector since we should now be watching that repo more closely.

  • Some reports of "Failed executing job: categoryMembershipChange" but not many lately.
Niedzielski (talk) 14:28, 21 May 2020 (UTC)
Logstash beta (credentials) ✅ Many notices matching PageImages but I think these can be safely ignored. Niedzielski (talk) 14:28, 21 May 2020 (UTC)
MobileFormatter lead paragraph transform alerts ✅ Highest was 35/24hrs in last week

Please don't delete this line: A normal error rate is around < 25 per 24 hrs.

Niedzielski (talk) 14:28, 21 May 2020 (UTC)
EventLogging validation errors ✅ No results found

These messages are being automatically excluded:

  • T216063: "Extra data: line 1 column C..."
  • T212330: "User Agent string length (L) longer than the allowed 800 chars" as well as odd webHost values (e.g. and
Niedzielski (talk) 14:28, 21 May 2020 (UTC)
Review dashboard ✅ Nothing
  • There's a number of mobilefrontend tasks here that the core platform team is working on - unsure if to put them in tracking or how to triage. Untagging mobilefrontend doesn't seem to be the right thing to do
  • JR: I tagged a few of these tracking.
NRay (WMF) (talk) 22:34, 18 May 2020 (UTC)
Review #mobile ✅ Moved 2 columns Jdlrobson (talk) 21:44, 14 May 2020 (UTC)
Check volunteer patches on Phab ✅

Patches that are not in the sprint

- (From Volker, in backlog)

- (From Demian, low priority) OOUI action=protect red link on search change blank user page

a few others low priority and config

Jdlrobson (talk) 17:56, 1 May 2020 (UTC)
Check volunteer patches on Gerrit ✅
  • Open patches seem to map to existing teams work. Nothing to flag.

Jdlrobson (talk) 16:41, 8 May 2020 (UTC)
Review the Reading Web Backlog ⚠️

looks good, prioritized some things Jdlrobson (talk) 16:41, 8 May 2020 (UTC)
Ensure goals are current ✅

Moved couple to sign off Jdlrobson (talk) 21:44, 14 May 2020 (UTC)
Performance Active banner campaigns are listed at Special:CentralNotice. Readers Web performance dashboards are listed here.
Page previews dashboard ✅ Looks steady

Previously: API request failures dropped suddenly on 4/9. Not sure what that's about, but I'll take it.

Looks ok Previously: Expanded default query to span 30days as it's easy to see anomalies. p95 API response time, Median TTP, and p75 TTP doubled from 1/13 for a span of ~7 hours but then returned to normal

Niedzielski (talk) 14:28, 21 May 2020 (UTC)

generic dashboard

⚠️⚠️ Minerva client errors now at 30k!

There's been a slight increase in EventLogging errors. Did we enable any schemas recently? MinervaClientError still climbing--in excess of 20k/min and moving towards 30k.

🧐Now Minerva client errors are consistently in the 20k/min range. About half of this seems to be an iPhone X bug. Opened T252223. - Minerva client error seems to be jumping between 22-10k/min since March 21. - Minerva client error rate still hovers between 6-10k/min. This seems to be the new norm. - The Minerva client error rate is a little higher than normal (5-15K/min on average) since the deploy on the 9th Jan (before that 5-8k/min). Might relate to caching changes in drawer and menu changes so probably worth further investigation.

Niedzielski (talk) 14:28, 21 May 2020 (UTC)
mobile performance dashboard ⚠️⚠️ Raised Desktop looks like it took a recent hit. <--thank you for identifying this!


Some weird looking spikes on beta cluster Obama page that jump up to > 1 min for some metrics (lastVisualChange, etc) but then settle back down.

Rapid oscillation of timing and speed indices since about Feb 1. Since Feb 29th, speed indices sure have gotten nice and smooth.

On 12th February release 1kb of additional CSS was shipped on mobile site due to banner campaign (see Reading/Web/Notable incidents)

BetaCluster CSS shot up 4KB on Jan 12 due to but that's now fixed.

Since 9  Jan speed index, fully loaded and first paint, visual complete, last visual change on Barack Obama page in production have worsened. Some even more so with the subsequent deploy. Could relate to main menu changes so created spike: T243105

1kb bump in CSS (likely due to the main menu changes). This seems to have increased first paint by 0.4s on 3G. Also seeming a bump in visual complete and speed index score. Too early to tell how this impacts NavigationTiming,

Speedindex 3G took a big hit on December 2. Fundraising campaign?

The graphs monitoring mobile Barack Obama have been a bit funky over the past month. Nothing alarming. A big spike in visual complete for the 99 percentile. A modest .1-.2kb increase in CSS was recorded on the 29th October.

All lines in right places but still unaccounted for regression in first paint ( I've documented on Notable incidents

Sept 27: Still the same performance regression noticed on 5th. No resolution and moving median suggests that it was a real regression. CSS/JS more or less the same.

Sept 9: Continuing to notice regression in lastVisualChange, etc. Seems related to below Sept 5: Big regression in first paint

Niedzielski (talk) 14:28, 21 May 2020 (UTC)
beta cluster dashboard ✅ Niedzielski (talk) 14:28, 21 May 2020 (UTC)
Check talk pages ⚠️ Main talk page looks good, feedback talk page needs a few replies. OVasileva (WMF) (talk) 13:46, 14 April 2020 (UTC)
Design backlog ⚠️ yeaaa, the design backlog is overgrown. I will need to work on this a bit more over the next month or two. AHollender (WMF) (talk) 18:43, 10 March 2020 (UTC)
Say something nice to a team member! 🎉 Thank you Jon for all of his hard work with the logo in header task! NRay (WMF) (talk) 21:31, 4 May 2020 (UTC)
Document notable events ✅ Up to date Niedzielski (talk) 14:28, 21 May 2020 (UTC)


Status fields:

✅ is fine
⚠️ needs attention
🚨 is on fire
🎉 For your attention but positive

Last updated (Use four tildes to autosign)

Link someone's username in the edit-summary to ping them! This will send them an Echo notification! Please list your preferred ping username below: