Reading/Web/Release timeline/Visual Changes

This page is a companion page to the Release timeline, which documents visual changes (both expected and unexpected) that went out in each release as caught by https://pixel.wmcloud.org/. If a release has no heading, this means there were no visual changes in that release. We began tracking visual changes for the wmf10 branch (comparing master against wmf.9).

Comparing origin/wmf/1.41.0-wmf.20 against master.
Page was last generated on: Tue Aug 08 2023 18:03:57 GMT+0000 (Coordinated Universal Time)

* Likely Backstop setting issue.
 * Test group: Login - 7 failures. Cause: The Backstop test snapshot is full-width while the ref snapshot is limited-width.*
 * Test group: web-maintained - 4 failures. Cause: Likely similar issue to last week with Codex changes. Mostly 1-2px differences in font size and an overall vertical shift-downward of 1-2px.
 * Echo - 30 failures - Cause: Missing hamburger and alert style is no longer rounded.**
 * Desktop - 66 failures - Cause: The limited width toggle button infobox rendering during the Backstop ref snapshot is causing the diff*
 * Mobile - 13 failures - Cause: The search button has shifted right by about 5 px.**
 * Desktop-dev - 36 failures - Cause: The ref and test have different page-width settings and sidebar pinned/unpinned settings, when they should be consistent.*

** Need further investigation

Comparing origin/wmf/1.41.0-wmf.20 against master.
Page was last generated on: Fri Aug 04 2023 17:07:23 GMT+0000 (Coordinated Universal Time)


 * Test group: login: 5 failures the button for login/create account has no margin between it and bottom input. I was unable to replicate this in the beta cluster and this also happened in previous deploys. Unclear why.
 * Test group: web-maintained - 2 failures in QuickSurvey due to Codex update. Not a problem.
 * Echo - 4 failures, also manually checked and not a problem, due to https://phabricator.wikimedia.org/T342907
 * Desktop - 0 failures.
 * Mobile - 1 failures due to reference drawer icon change (expected)
 * Desktop-dev - 1 failure

Comparing origin/wmf/1.41.0-wmf.19 against master.
Test ran on Tue Aug 01 2023 00:36:33 GMT+0000 (Coordinated Universal Time)


 * Mobile - 48 visual changes, relating to the switch to Codex (https://phabricator.wikimedia.org/T340262). All have been manually checked.

Comparing origin/wmf/1.41.0-wmf.18 (Includes 937187) against master.
Test ran on Mon Jul 24 2023 20:04:12 GMT+0000 (Coordinated Universal Time)


 * Desktop - 1 failure, seems fine just subpixel change to the limited width popup notification

Comparing origin/wmf/1.41.0-wmf.18 against master.
Test ran on Thu Jul 20 2023 11:08:10 GMT+0000 (Coordinated Universal Time)


 * Codex - (4 failures) captured in https://phabricator.wikimedia.org/T342190

Comparing origin/wmf/1.41.0-wmf.15 against master.
Test ran on Mon Jul 03 2023 17:05:23 GMT+0000 (Coordinated Universal Time)
 * All green except campaign-events test group (27 failures due to text change from `Add username` to `Add more` and error warnings have different numbers). No blockers.

Comparing origin/wmf/1.41.0-wmf.13 against master.
16 failures due to language button missing on main page. Some issues around language button missing related to T315036


 * /web-maintained - some errors in NearbyPages due to change in defaults. Some z-index issues in Timeless. Not blockers.

Comparing origin/wmf/1.41.0-wmf.12 against master.
Test ran on Fri Jun 09 2023 23:41:34 GMT+0000 (Coordinated Universal Time)


 * Mobile has 5 errors due to https://gerrit.wikimedia.org/r/c/mediawiki/skins/MinervaNeue/+/923383/
 * 4 failures in CologneBlue due to sub title padding (won't fix)

Comparing origin/wmf/1.41.0-wmf.10 against master.
Test ran on Mon May 29 2023 14:34:30 GMT+0000 (Coordinated Universal Time)


 * Notification Overlay error in MinervaNeue due to Codex z-index update.
 * 2 pixel border pushes content down by 1px.

Comparing origin/wmf/1.41.0-wmf.8 against master.
Last checked: Jdlrobson (talk) 18:48, 2 May 2023 (UTC)
 * Desktop: 8 failures due to https://gerrit.wikimedia.org/r/c/mediawiki/core/+/918598
 * Monobook: TOC text color looks slightly darker

Comparing origin/wmf/1.41.0-wmf.7 against master.
Last checked: Jdlrobson (talk) 18:48, 2 May 2023 (UTC)
 * Desktop: 0 failures

Comparing origin/wmf/1.41.0-wmf.6 against master.
Last checked: Jdlrobson (talk) 23:09, 1 May 2023 (UTC)
 * Desktop: 3 failures
 * 91 failures - all accounted for https://gerrit.wikimedia.org/r/c/mediawiki/core/+/908524
 * 3 failures presumably because of c/mediawiki/skins/Vector/+/914023.
 * web-maintained: 15 failures
 * 15 failures presumably due to subtle color change in message box component. https://gerrit.wikimedia.org/r/c/mediawiki/core/+/908524

Comparing origin/wmf/1.41.0-wmf.1 (Includes 884918) against master.
Jdlrobson (talk) 21:12, 24 March 2023 (UTC)

All green.

Comparing origin/wmf/1.40.0-wmf.26 against master.
NRay (WMF) (talk) 19:26, 10 March 2023 (UTC)

- web-maintained: 5 visual changes involving the bottom of the footer chanigng position, but I couldn't replicate this locally so I'm assuming the test is somehow flaky.

Comparing origin/wmf/1.40.0-wmf.24 against master.
BWang (WMF) (talk) 20:07, 23 February 2023 (UTC), Jdlrobson (talk) 23:25, 27 February 2023 (UTC)

- Desktop: 28 expected visual changes from 889828 and 889859 and 884907

Comparing origin/wmf/1.40.0-wmf.23 against master.
NRay (WMF) (talk) 19:31, 17 February 2023 (UTC)

- Desktop: 831143 makes the TOC appear in new places (expected).

- Echo: 0

- Mobile: 0

- Web-maintained: 0

Comparing origin/wmf/1.40.0-wmf.22 against master.
Jdlrobson (talk) 00:32, 9 February 2023 (UTC)

- Desktop: There will be many visual changes to the TOC as a result of https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/886437, 2 relating to Growth team changes to newcomer homepage; 6 relating to a shift in the "search for pages containing" (T329287), 7 relating to https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/888109

Comparing origin/wmf/1.40.0-wmf.21 against master.
Jdlrobson (talk) 23:29, 6 February 2023 (UTC)

- Desktop: 6 failures because the thumbnails on typeahead are slightly larger in size (more info), rises to 17 with T325020 and up to 66 with moving login link (updated Pixel so these do not show)

- Web-maintained: 60 failures due to very slight difference in text alignment (text looks more vertically centered in master) as well as slightly larger thumbnail sizes in Nearby page (due to change in Codex, more info).

- Echo: 3 failures due to expected change (updated Pixel so these do not show)

- Mobile: 0 failures

Comparing origin/wmf/1.40.0-wmf.21 against master.
Jdlrobson (talk) 23:29, 6 February 2023 (UTC)

- Desktop: 6 failures because the thumbnails on typeahead are slightly larger in size (more info), rises to 17 with T325020 and up to 66 with moving login link (updated Pixel so these do not show)

- Web-maintained: 60 failures due to very slight difference in text alignment (text looks more vertically centered in master) as well as slightly larger thumbnail sizes in Nearby page (due to change in Codex, more info).

- Echo: 3 failures due to expected change (updated Pixel so these do not show)

- Mobile: 0 failures

Comparing origin/wmf/1.40.0-wmf.20 against master.
Jdlrobson (talk) 23:01, 26 January 2023 (UTC)


 * Echo: Green
 * Desktop: 38 intentional failures involving the expanded TOC from T328045
 * Mobile: Green
 * Web-maintained: Green

Comparing origin/wmf/1.40.0-wmf.19 against master.
Jdlrobson (talk) 21:46, 18 January 2023 (UTC)
 * Echo: Green
 * Desktop: Green
 * Mobile: Green
 * web-maintained: Green
 * Desktop-dev: Green = Stability?!!

Comparing origin/wmf/1.40.0-wmf.18 against master

 * Desktop: https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/877255 will cause 4 minor changes to the dimensions of the collapsed TOC https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/877243/ will cause 16 progressions to the spacing of the TOC button in the page title and sticky header

Comparing origin/wmf/1.40.0-wmf.17 (Includes 861946,866657) against master
Jdlrobson (talk) 19:28, 9 January 2023 (UTC)
 * Echo: Green
 * Desktop: 40 failures due 852139, 861946 ((T316559). Caught T326538
 * Mobile: Green
 * web-maintained: 39 failures (expected)

Comparing origin/wmf/1.40.0-wmf.14 against master.
Jdlrobson (talk) 00:25, 15 December 2022 (UTC)


 * Echo: Green
 * Desktop: 9 failures due 861946
 * Mobile: 33 failures due to 866657
 * web-maintained: Green
 * Desktop-dev: (Failures to be expected) 84 failures

Comparing origin/wmf/1.40.0-wmf.13 (Includes 865151) against master.
Jdlrobson (talk) 22:30, 9 December 2022 (UTC)


 * Echo: Green
 * Desktop: Green Green [6 failures (improvements) relating to Codex release]
 * Mobile: 33 failures due to https://phabricator.wikimedia.org/T324876
 * web-maintained: Green
 * Desktop-dev: (Failures to be expected) 6 failures

Comparing origin/wmf/1.40.0-wmf.12 (Includes 859135) against master.
Last updated Jdlrobson (talk) 21:50, 5 December 2022 (UTC)


 * Echo: Green
 * Desktop: 58 failures relating to expected visual changes in https://phabricator.wikimedia.org/T318013 (gerrit) and T323172 (26, gerrit).
 * Mobile: Green
 * web-maintained: Green
 * Desktop-dev: (Failures to be expected) 3 failures due to https://phabricator.wikimedia.org/T318013

Comparing origin/wmf/1.40.0-wmf.10 against master.
Last updated Jdlrobson (talk) 17:03, 16 November 2022 (UTC)
 * Echo: Green
 * Desktop: 4 failures but all should be fixed by https://github.com/wikimedia/pixel/commit/6958c771ffa0226caca3f531b63878f048fe2697, 5 caused by the Codex update
 * Mobile: Green
 * web-maintained: Green
 * Desktop-dev: (Failures to be expected) We have a tools menu!

Comparing origin/wmf/1.40.0-wmf.9 (Includes 838818) against master.

 * N/A (no train this week)

Comparing origin/wmf/1.40.0-wmf.8 (Includes 838818) against master.
Last updated Jdlrobson (talk) 23:56, 9 November 2022 (UTC)
 * Echo: 20 failures. Most relating to 854129. Caught an issue in legacy Vector which was fixed.
 * Desktop: 89 failures relating to 854129 and the related feature flag and 850290. Fixes: 855156, 855158
 * Mobile: Green
 * web-maintained: FLAGGING some issues with Nearby pages relating to i18n change.

Comparing origin/wmf/1.40.0-wmf.7 (Includes 838818) against master.
Last updated: Jdlrobson (talk) 16:13, 26 October 2022 (UTC)
 * Echo: Green
 * Desktop: 4 failures due to expected bug fix T317902
 * Mobile: Green
 * web-maintained: Green

Comparing origin/wmf/1.40.0-wmf.6 (Includes 838818) against master.
Last updated: Jdlrobson (talk) 18:13, 24 October 2022 (UTC)
 * Echo: Green
 * Desktop: Green (note several issues in this cycle relating to https://phabricator.wikimedia.org/T320449#8327604)
 * Mobile: Green
 * web-maintained: Green

Comparing origin/wmf/1.40.0-wmf.5 (Includes 838818) against master.
Last updated: 7 October 2022 11:50AM PST
 * Echo: Green
 * Desktop: Green
 * Mobile: Green
 * web-maintained: Green

Comparing origin/wmf/1.40.0-wmf.4 against master..
Last updated: 6 October 2022


 * Echo: Green
 * Desktop: Green
 * Mobile: Green
 * web-maintained: Green

Comparing origin/wmf/1.40.0-wmf.3 against master..
Last updated: 29 September 2022


 * Echo: Green
 * Desktop: 4 errors, regression fixed by https://gerrit.wikimedia.org/r/c/mediawiki/extensions/NearbyPages/+/836929
 * Mobile: Green
 * web-maintained: Green

Comparing origin/wmf/1.40.0-wmf.2 against master..
Last updated: 23 September 2022


 * Echo: Green
 * Desktop: Green (note previousl expected visual changes relating to bolding of active TOC section were shown but the bolding behaviour is not supposed to be flagged by PixelT316032)
 * Mobile: Green
 * web-maintained: Green

Comparing origin/wmf/1.40.0-wmf.1 against master..
Last updated: 15 September 2022


 * Echo: Green
 * Desktop: 1 unexpected visual change relating T317902, 11 expected due to
 * Mobile: 1 unexpected visual change relating to page actions color. Could not replicate on beta cluster.
 * web-maintained: Green

Comparing origin/wmf/1.39.0-wmf.28 against master.
Last updated: 13 September 2022 Expected visual changes documented in https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/830955

Comparing origin/wmf/1.39.0-wmf.28 against master.
Last updated: 9 September 2022
 * Echo: Green
 * Desktop: 4 failures, 3 footer-related, 1 related to TOC bolding?
 * Mobile: Green
 * web-maintained: Green

8 September 2022:
 * Desktop: 98 failures, due to T315261 and T315615, which affect the alignment of many elements including the header and page container. All changes are expected

Comparing origin/wmf/1.39.0-wmf.27 against master.
Last updated: 31 August 2022
 * Echo: Green
 * Desktop: 3 failures, 2 due to T314670, 1 due to pixel failure with "ENGINE ERROR: Evaluation failed: Cannot find module vue." error
 * Mobile: Green
 * web-maintained: 2 failures on Timeless -- maybe due to https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/819178? Logged T316789

Comparing origin/wmf/1.39.0-wmf.26 against master.
Last updated: 23 August 2022
 * Echo: Green
 * Desktop: 33 failures (expected: T315595), 7 due to T307715, 21 due to https://phabricator.wikimedia.org/T314670, Pixel #99 and external link icon change T261391
 * Mobile: Green
 * web-maintained: Green

Comparing origin/wmf/1.39.0-wmf.25 against master.
Last updated: 17 August 2022
 * Echo: 13 failures due to font change (T213778)
 * Desktop: 1 failure (MediaWiki_Main_Page_vector-2022_0_viewport_0_phone.png) may relate to T306440, Note flakiness: https://github.com/wikimedia/pixel/issues/96, 83 failures due to font color change (T213778)
 * Mobile: Green
 * web-maintained: Green

Comparing origin/wmf/1.39.0-wmf.24 against master.
Last updated: 15 August 2022
 * Echo: 14 failures due to https://phabricator.wikimedia.org/T312157
 * Desktop: 45 fails due to https://phabricator.wikimedia.org/T312157 and T307771
 * Mobile: Green
 * web-maintained: Green

Comparing origin/wmf/1.39.0-wmf.23 against master.
Last updated: 9 August 2022
 * Echo: Green but it hasn't run since 7/8/22 with 1.39.0-wmf.19 against master
 * Desktop: 69 fails - I believe these are expected but we're having some issues with Pixel atm
 * Mobile: Green
 * web-maintained: 12 fails - all related to the Privacy Policy icon which shifted ever so slightly

Comparing origin/wmf/1.39.0-wmf.22 against master.
Last updated: 29 July 2022
 * Echo (1.39.0-wmf.19 against master): Green
 * Desktop: Green
 * Mobile: Green
 * web-maintained: 30 passes, 22 failures (due to external link icon change in QuickSurvey (T261391). Expected change.)

Comparing origin/wmf/1.39.0-wmf.21 against master.
Last updated: 21 July 2022
 * Echo: Green
 * Desktop: 67 failures due:
 * Search: Introduction of Codex (758961)
 * Tabs: Changes to the language variant dropdown position ( 815323) and chevron (814234/)
 * Link: External link icon change (T261391)
 * Footer, TOC: The new grid was rolled out resulting in changes to the footer and table of contents alignment (T312241)
 * TOC: Changes to table of contents text alignment and padding (815768)
 * Mobile: Green
 * web-maintained: 30 passes, 22 failures (due to external link icon change in QuickSurvey (T261391). Expected change.)

Comparing origin/wmf/1.39.0-wmf.20 against master.
Last updated: 18 July 2022
 * Echo: Green
 * Desktop: Green
 * Mobile: 8 failures due to the fix for https://phabricator.wikimedia.org/T312864

Comparing 808059 against master. (Fastforward of "origin/wmf/1.39.0-wmf.19")
Last updated: 7 July 2022


 * Echo: Green
 * Desktop: Green
 * Mobile: Green

Comparing origin/wmf/1.39.0-wmf.19 against master.
Last updated: 5 July 2022


 * Echo: Green
 * Desktop:
 * 11 failures were reported due to https://gerrit.wikimedia.org/r/808059. All visual changes were manually reviewed and expected. The reference point was updated.
 * Mobile: Green

Comparing origin/wmf/1.39.0-wmf.18 against master.
Last updated: 28 June 2022


 * Echo: Green
 * Desktop: 15 failures.
 * Tablet viewport:
 * Expected: The surplus more menu has been removed (see T310536) introduced in 808080.
 * Desktop viewport:
 * Expected: The table of contents in the sidebar now shows on scroll (see T310536) introduced in 808080.
 * Expected: The sticky header now shows (see T310536), introduced in 808080.
 * Mobile: Green

Comparing origin/wmf/1.39.0-wmf.17 against master.
Last updated: 27 June 2022


 * Echo: Green
 * Desktop: 6 failures.
 * Expected: The table of contents icon shows on scroll (new feature) on mobile devices (phab:T308689).
 * Expected (to be confirmed): The margin for the table of contents iswhen scrolling without the sticky header and main menu is open has been modified (phab:T309807).
 * Mobile: Green

Regressions caught: T311283, T310536, T311319, T309807,

Comparing origin/wmf/1.39.0-wmf.16 against master.
Last updated: 15th June 2022


 * Echo: 14 failures due to table of contents icon alignment (documented in T307900. It seems unintentional that the table of contents in the sidebar is also moving.
 * Desktop: 56 failures assumed to be intentional related to heading border and icon alignment (T310533 and T307900). There is also a change in the bottom border of the article heading in both legacy and vector-2022 that is intentional.
 * Mobile: 0 failures

Comparing origin/wmf/1.39.0-wmf.15 against master.
Last updated: 8th June 2022


 * Mobile: All green
 * Desktop: [Regression] color change for bottom border of legacy Vector's h1 element. 62 failures but the rest are assumed to be intentional (T310197)
 * Echo: 20 failures related to the desktop layout changes

Comparing master against origin/wmf/1.39.0-wmf.14
Last updated: 6 June 2022


 * Mobile: All green
 * Desktop: [Regression] Spacing between sidebar and TOC has increased. Three failures relating to ULS settings cog. Seems to be a false positive.
 * Echo: All green

Comparing master against origin/wmf/1.39.0-wmf.13
Last updated: 24 May 2022

All green

Comparing master against origin/wmf/1.39.0-wmf.12
Last updated: 23 May 2022

Desktop has 14 failures. 8 of these are on the history page and report the reference images having no revision history but those are false positives and is a result of a database schema change that occurred this week and that affected the revision table (Pixel should be more resilient to DB schema changes in the future).

Mobile (5 failed/15 pass): The notification and search icons will show a small shift due to https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Echo/+/793114. This is expected. The settings link was restored to the main menu (https://phabricator.wikimedia.org/T307696) leading to more expected failures in minerva_mobile_mainmenu-open.

Comparing master against origin/wmf/1.39.0-wmf.11
Last updated: 12th May 2022

All desktop tests are passing.

Mobile (7 failed/13 pass): Mobile tests were introduced but are flaky due to the sidebar animation and layout shift involving the footer logo. The latter should be resolved in.

Comparing master against origin/wmf/1.39.0-wmf.10
Last updated: 6th May 2022

22 passed | 38 failed (36% pass)

The failures here were due to expected changes:


 * [Expected] Fix spacing/margins for screens between 1000 and 1200 px
 * [Expected] Previously the height between the page title and the content was different on special pages vs regular pages. This was corrected in 789207
 * [Expected] The introduction of the toolbar component in 787562 led to slight pixel misalignment in the article namespace and action tabs. This was expected preparation for the introduction of a grid system to Vector and moving the article tools below the title.

Comparing master against origin/wmf/1.39.0-wmf.9
Last updated: 2nd May 2022

47 passed | 13 failed (78% pass)


 * 1) [Expected] We’re collapsing things into the more menu at lower breakpoints to make things more predictable. As a result edit icon will be hidden under more menu at lower resolutions now. There was one unexpected bug associated with this on history and Special:RecentChanges which will be fixed by 787801 so that this issue didn't got out with the release.
 * 2) [Expected] We changed the alignment of logo with table of contents and search with tabs
 * 3) [Regression]  Main menu placement is off on screens 700-1000px