Reading/Web/Release timeline/Visual Changes

From mediawiki.org

This page is a companion page to the Release timeline, which documents visual changes (both expected and unexpected) that went out in each release as caught by https://pixel.wmcloud.org/. If a release has no heading, this means there were no visual changes in that release. We began tracking visual changes for the wmf10 branch (comparing master against wmf.9).

2024[edit]

Comparing origin/wmf/1.42.0-wmf.23 against master[edit]

(March 25, 2024)

Unexpected

Comparing origin/wmf/1.42.0-wmf.20 against master[edit]

(March 5, 2024)

  • 5 on web-maintained - 4 relating to cologneblue skin and 1 suspected codex issue
  • 8 on desktop-dev related to removal of language links notice
  • 48 on codex, investigating now
  • 45 on wikilambda, seem unrelated to our work

Expected: Language links notice removal due to https://phabricator.wikimedia.org/T353619

Unexpected: box shadow issues (resolved) and codex issues. I (Steph) am not personally worried about wikilambda failures

Comparing origin/wmf/1.42.0-wmf.19 (Includes 989911) against master.[edit]

(Feb 23, 2024 )

Expected changes: Slight alignment differences between icons and their labels due to latest Codex release.

Unexpected: Footer margin seems to have changed on desktop, doesn't seem like a significant regression.

Echo:

  • on Friday there were 23 failures due to Night mode being enabled unintentionally on day mode. Suspect this to be less when checked again on Monday.

Comparing origin/wmf/1.42.0-wmf.17 against master.[edit]

(Feb 12, 2024 Re-Run)

Same as previous, except:

web-maintained (previous: 20) 31

mobile (previous: 4) 72

Reasons same as previous.

Comparing origin/wmf/1.42.0-wmf.17 against master.[edit]

Others: No regressions

Comparing origin/wmf/1.42.0-wmf.16 against master.[edit]

No regressions.

2023[edit]

Comparing origin/wmf/1.42.0-wmf.14 against master.[edit]

Comparing origin/wmf/1.42.0-wmf.9 against master.[edit]

Comparing origin/wmf/1.42.0-wmf.7 against master.[edit]

  • mobile - 2 failures due to T351946
  • web-maintained 1 false positive
  • desktop-dev 5 false positive due to change on paragraph spacing.
  • desktop 16 false positive due to text change of alert in the right side/ main menu --- this relates to loading the full codex library T353071
  • wikilambda 1 vertical scroll on header, 1 false positive

Comparing origin/wmf/1.42.0-wmf.4 against master.[edit]

  • web-maintained - 3 failures (Survey false flags)
  • desktop-dev - 3 failures (Text change false flags)

Comparing origin/wmf/1.42.0-wmf.3 against master.[edit]

  • Mobile - 22 failures due to T350627
  • Web maintained - 2 false positives. Will see if I can mute those.

Comparing origin/wmf/1.42.0-wmf.2 against master.[edit]

Comparing origin/wmf/1.41.0-wmf.30 against master.[edit]

Comparing origin/wmf/1.41.0-wmf.30 against master.

Comparing origin/wmf/1.41.0-wmf.29 against master.[edit]

Comparing origin/wmf/1.41.0-wmf.29 against master.

Comparing origin/wmf/1.41.0-wmf.26 against master.[edit]

Test ran on Sun Sep 17 2023 23:06:07 GMT+0000 (Coordinated Universal Time)

Comparing origin/wmf/1.41.0-wmf.25 against master.[edit]

Test ran on Thu Aug 10 2023 18:08:02 GMT+0000 (Coordinated Universal Time)

mobile - 0 failures

desktop - 1 failures, false alarm

Echo - 6 failures relating to Codex switchover.

login - 2 failures. Flakiness.

QuickSurveys - 2 failures. Codex?

Comparing origin/wmf/1.41.0-wmf.20 against master.[edit]

Page was last generated on: Fri Aug 11 2023 19:07:48 GMT+0000 (Coordinated Universal Time)

  • Test group: Login - 2 failures. Cause: Flakiness. **
  • Test group: web-maintained - 2 failures. Cause: Likely similar issue to last week with Codex changes. Mostly 1-2px differences in font size and an overall <body> vertical shift-downward of 1-2px.
  • Echo - 6 failures - Cause: https://phabricator.wikimedia.org/T342907
  • Desktop - 1 failures - Cause: Flakiness
  • Mobile - 67 failures - Cause: https://phabricator.wikimedia.org/T342908 Mostly icon related (alignment/size). Issues of concern relating to default editor will hopefully be fixed in next run. **
  • Desktop-dev - 2 failures - Cause: Nothing important.

**Need further investigation

Comparing origin/wmf/1.41.0-wmf.20 against master.[edit]

Page was last generated on: Fri Aug 04 2023 17:07:23 GMT+0000 (Coordinated Universal Time)

  • Test group: login: 5 failures the button for login/create account has no margin between it and bottom input. I was unable to replicate this in the beta cluster and this also happened in previous deploys. Unclear why.
  • Test group: web-maintained - 2 failures in QuickSurvey due to Codex update. Not a problem.
  • Echo - 4 failures, also manually checked and not a problem, due to https://phabricator.wikimedia.org/T342907
  • Desktop - 0 failures.
  • Mobile - 1 failures due to reference drawer icon change (expected)
  • Desktop-dev - 1 failure

Comparing origin/wmf/1.41.0-wmf.19 against master.[edit]

Test ran on Tue Aug 01 2023 00:36:33 GMT+0000 (Coordinated Universal Time)

Comparing origin/wmf/1.41.0-wmf.18 (Includes 937187) against master.[edit]

Test ran on Mon Jul 24 2023 20:04:12 GMT+0000 (Coordinated Universal Time)

  • Desktop - 1 failure, seems fine just subpixel change to the limited width popup notification

Comparing origin/wmf/1.41.0-wmf.18 against master.[edit]

Test ran on Thu Jul 20 2023 11:08:10 GMT+0000 (Coordinated Universal Time)

Comparing origin/wmf/1.41.0-wmf.15 against master.[edit]

Test ran on Mon Jul 03 2023 17:05:23 GMT+0000 (Coordinated Universal Time)

  • All green except campaign-events test group (27 failures due to text change from `Add username` to `Add more` and error warnings have different numbers). No blockers.

Comparing origin/wmf/1.41.0-wmf.13 against master.[edit]

16 failures due to language button missing on main page. Some issues around language button missing related to T315036

Comparing origin/wmf/1.41.0-wmf.12 against master.[edit]

Test ran on Fri Jun 09 2023 23:41:34 GMT+0000 (Coordinated Universal Time)

Comparing origin/wmf/1.41.0-wmf.10 against master.[edit]

Test ran on Mon May 29 2023 14:34:30 GMT+0000 (Coordinated Universal Time)

  • Notification Overlay error in MinervaNeue due to Codex z-index update.
  • 2 pixel border pushes content down by 1px.

Comparing origin/wmf/1.41.0-wmf.8 against master.[edit]

Last checked: Jdlrobson (talk) 18:48, 2 May 2023 (UTC)[reply]

Comparing origin/wmf/1.41.0-wmf.7 against master.[edit]

Last checked: Jdlrobson (talk) 18:48, 2 May 2023 (UTC)[reply]

  • Desktop: 0 failures

Comparing origin/wmf/1.41.0-wmf.6 against master.[edit]

Last checked: Jdlrobson (talk) 23:09, 1 May 2023 (UTC)[reply]

Comparing origin/wmf/1.41.0-wmf.1 (Includes 884918) against master.[edit]

Jdlrobson (talk) 21:12, 24 March 2023 (UTC)[reply]

All green.

Comparing origin/wmf/1.40.0-wmf.26 against master.[edit]

NRay (WMF) (talk) 19:26, 10 March 2023 (UTC)[reply]

- web-maintained: 5 visual changes involving the bottom of the footer chanigng position, but I couldn't replicate this locally so I'm assuming the test is somehow flaky.

Comparing origin/wmf/1.40.0-wmf.24 against master.[edit]

BWang (WMF) (talk) 20:07, 23 February 2023 (UTC), Jdlrobson (talk) 23:25, 27 February 2023 (UTC)[reply]

- Desktop: 28 expected visual changes from 889828 and 889859 and 884907

Comparing origin/wmf/1.40.0-wmf.23 against master.[edit]

NRay (WMF) (talk) 19:31, 17 February 2023 (UTC)[reply]

- Desktop: 831143 makes the TOC appear in new places (expected).

- Echo: 0

- Mobile: 0

- Web-maintained: 0

Comparing origin/wmf/1.40.0-wmf.22 against master.[edit]

Jdlrobson (talk) 00:32, 9 February 2023 (UTC)[reply]

- Desktop: There will be many visual changes to the TOC as a result of https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/886437, 2 relating to Growth team changes to newcomer homepage; 6 relating to a shift in the "search for pages containing" (T329287), 7 relating to https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/888109

Comparing origin/wmf/1.40.0-wmf.21 against master.[edit]

Jdlrobson (talk) 23:29, 6 February 2023 (UTC)[reply]

- Desktop: 6 failures because the thumbnails on typeahead are slightly larger in size (more info), rises to 17 with T325020 and up to 66 with moving login link (updated Pixel so these do not show)

- Web-maintained: 60 failures due to very slight difference in text alignment (text looks more vertically centered in master) as well as slightly larger thumbnail sizes in Nearby page (due to change in Codex, more info).

- Echo: 3 failures due to expected change (updated Pixel so these do not show)

- Mobile: 0 failures

Comparing origin/wmf/1.40.0-wmf.21 against master.[edit]

Jdlrobson (talk) 23:29, 6 February 2023 (UTC)[reply]

- Desktop: 6 failures because the thumbnails on typeahead are slightly larger in size (more info), rises to 17 with T325020 and up to 66 with moving login link (updated Pixel so these do not show)

- Web-maintained: 60 failures due to very slight difference in text alignment (text looks more vertically centered in master) as well as slightly larger thumbnail sizes in Nearby page (due to change in Codex, more info).

- Echo: 3 failures due to expected change (updated Pixel so these do not show)

- Mobile: 0 failures

2022[edit]

Comparing origin/wmf/1.40.0-wmf.20 against master.[edit]

Jdlrobson (talk) 23:01, 26 January 2023 (UTC)[reply]

  • Echo: Green
  • Desktop: 38 intentional failures involving the expanded TOC from T328045
  • Mobile: Green
  • Web-maintained: Green

Comparing origin/wmf/1.40.0-wmf.19 against master.[edit]

Jdlrobson (talk) 21:46, 18 January 2023 (UTC)[reply]

  • Echo: Green
  • Desktop: Green
  • Mobile: Green
  • web-maintained: Green
  • Desktop-dev: Green = Stability?!!

Comparing origin/wmf/1.40.0-wmf.18 against master[edit]

Comparing origin/wmf/1.40.0-wmf.17 (Includes 861946,866657) against master[edit]

Jdlrobson (talk) 19:28, 9 January 2023 (UTC)[reply]

Comparing origin/wmf/1.40.0-wmf.14 against master.[edit]

Jdlrobson (talk) 00:25, 15 December 2022 (UTC)[reply]

  • Echo: Green
  • Desktop: 9 failures due 861946
  • Mobile: 33 failures due to 866657
  • web-maintained: Green
  • Desktop-dev: (Failures to be expected) 84 failures

Comparing origin/wmf/1.40.0-wmf.13 (Includes 865151) against master.[edit]

Jdlrobson (talk) 22:30, 9 December 2022 (UTC)[reply]

Comparing origin/wmf/1.40.0-wmf.12 (Includes 859135) against master.[edit]

Last updated Jdlrobson (talk) 21:50, 5 December 2022 (UTC)[reply]

Comparing origin/wmf/1.40.0-wmf.10 against master.[edit]

Last updated Jdlrobson (talk) 17:03, 16 November 2022 (UTC)[reply]

Comparing origin/wmf/1.40.0-wmf.9 (Includes 838818) against master.[edit]

  • N/A (no train this week)

Comparing origin/wmf/1.40.0-wmf.8 (Includes 838818) against master.[edit]

Last updated Jdlrobson (talk) 23:56, 9 November 2022 (UTC)[reply]

  • Echo: 20 failures. Most relating to 854129. Caught an issue in legacy Vector which was fixed.
  • Desktop: 89 failures relating to 854129 and the related feature flag and 850290. Fixes: 855156, 855158
  • Mobile: Green
  • web-maintained: FLAGGING some issues with Nearby pages relating to i18n change.

Comparing origin/wmf/1.40.0-wmf.7 (Includes 838818) against master.[edit]

Last updated: Jdlrobson (talk) 16:13, 26 October 2022 (UTC)[reply]

  • Echo: Green
  • Desktop: 4 failures due to expected bug fix T317902
  • Mobile: Green
  • web-maintained: Green

Comparing origin/wmf/1.40.0-wmf.6 (Includes 838818) against master.[edit]

Last updated: Jdlrobson (talk) 18:13, 24 October 2022 (UTC)[reply]

Comparing origin/wmf/1.40.0-wmf.5 (Includes 838818) against master.[edit]

Last updated: 7 October 2022 11:50AM PST

  • Echo: Green
  • Desktop: Green
  • Mobile: Green
  • web-maintained: Green

Comparing origin/wmf/1.40.0-wmf.4 against master..[edit]

Last updated: 6 October 2022

  • Echo: Green
  • Desktop: Green
  • Mobile: Green
  • web-maintained: Green

Comparing origin/wmf/1.40.0-wmf.3 against master..[edit]

Last updated: 29 September 2022

Comparing origin/wmf/1.40.0-wmf.2 against master..[edit]

Last updated: 23 September 2022

  • Echo: Green
  • Desktop: Green (note previousl expected visual changes relating to bolding of active TOC section were shown but the bolding behaviour is not supposed to be flagged by PixelT316032)
  • Mobile: Green
  • web-maintained: Green

Comparing origin/wmf/1.40.0-wmf.1 against master..[edit]

Last updated: 15 September 2022

  • Echo: Green
  • Desktop: 1 unexpected visual change relating T317902, 11 expected due to Gerrit change 831126
  • Mobile: 1 unexpected visual change relating to page actions color. Could not replicate on beta cluster.
  • web-maintained: Green

Comparing origin/wmf/1.39.0-wmf.28 against master.[edit]

Last updated: 13 September 2022 Expected visual changes documented in https://gerrit.wikimedia.org/r/c/mediawiki/skins/Vector/+/830955

Comparing origin/wmf/1.39.0-wmf.28 against master.[edit]

Last updated: 9 September 2022

  • Echo: Green
  • Desktop: 4 failures, 3 footer-related, 1 related to TOC bolding?
  • Mobile: Green
  • web-maintained: Green

8 September 2022:

  • Desktop: 98 failures, due to T315261 and T315615, which affect the alignment of many elements including the header and page container. All changes are expected

Comparing origin/wmf/1.39.0-wmf.27 against master.[edit]

Last updated: 31 August 2022

Comparing origin/wmf/1.39.0-wmf.26 against master.[edit]

Last updated: 23 August 2022

Comparing origin/wmf/1.39.0-wmf.25 against master.[edit]

Last updated: 17 August 2022

Comparing origin/wmf/1.39.0-wmf.24 against master.[edit]

Last updated: 15 August 2022

Comparing origin/wmf/1.39.0-wmf.23 against master.[edit]

Last updated: 9 August 2022

  • Echo: Green but it hasn't run since 7/8/22 with 1.39.0-wmf.19 against master
  • Desktop: 69 fails - I believe these are expected but we're having some issues with Pixel atm
  • Mobile: Green
  • web-maintained: 12 fails - all related to the Privacy Policy icon which shifted ever so slightly

Comparing origin/wmf/1.39.0-wmf.22 against master.[edit]

Last updated: 29 July 2022

  • Echo (1.39.0-wmf.19 against master): Green
  • Desktop: Green
  • Mobile: Green
  • web-maintained: 30 passes, 22 failures (due to external link icon change in QuickSurvey (phab:T261391). Expected change.)

Comparing origin/wmf/1.39.0-wmf.21 against master.[edit]

Last updated: 21 July 2022

  • Echo: Green
  • Desktop: 67 failures due:
    • Search: Introduction of Codex (758961)
    • Tabs: Changes to the language variant dropdown position ( 815323) and chevron (814234/)
    • Link: External link icon change (phab:T261391)
    • Footer, TOC: The new grid was rolled out resulting in changes to the footer and table of contents alignment (phab:T312241)
    • TOC: Changes to table of contents text alignment and padding (815768)
  • Mobile: Green
  • web-maintained: 30 passes, 22 failures (due to external link icon change in QuickSurvey (phab:T261391). Expected change.)

Comparing origin/wmf/1.39.0-wmf.20 against master.[edit]

Last updated: 18 July 2022

Comparing 808059 against master. (Fastforward of "origin/wmf/1.39.0-wmf.19")[edit]

Last updated: 7 July 2022

  • Echo: Green
  • Desktop: Green
  • Mobile: Green

Comparing origin/wmf/1.39.0-wmf.19 against master.[edit]

Last updated: 5 July 2022

  • Echo: Green
  • Desktop:
  • Mobile: Green

Comparing origin/wmf/1.39.0-wmf.18 against master.[edit]

Last updated: 28 June 2022

  • Echo: Green
  • Desktop: 15 failures.
    • Tablet viewport:
      • Expected: The surplus more menu has been removed (see T310536) introduced in 808080.
    • Desktop viewport:
      • Expected: The table of contents in the sidebar now shows on scroll (see T310536) introduced in 808080.
      • Expected: The sticky header now shows (see T310536), introduced in 808080.
  • Mobile: Green

Comparing origin/wmf/1.39.0-wmf.17 against master.[edit]

Last updated: 27 June 2022

  • Echo: Green
  • Desktop: 6 failures.
    • Expected: The table of contents icon shows on scroll (new feature) on mobile devices (phab:T308689).
    • Expected (to be confirmed): The margin for the table of contents iswhen scrolling without the sticky header and main menu is open has been modified (phab:T309807).
  • Mobile: Green

Regressions caught: phab:T311283, phab:T310536, phab:T311319, phab:T309807,

Comparing origin/wmf/1.39.0-wmf.16 against master.[edit]

Last updated: 15th June 2022

  • Echo: 14 failures due to table of contents icon alignment (documented in phab:T307900#7999651. It seems unintentional that the table of contents in the sidebar is also moving.
  • Desktop: 56 failures assumed to be intentional related to heading border and icon alignment (phab:T310533 and phab:T307900#7999651). There is also a change in the bottom border of the article heading in both legacy and vector-2022 that is intentional.
  • Mobile: 0 failures

Comparing origin/wmf/1.39.0-wmf.15 against master.[edit]

Last updated: 8th June 2022

  • Mobile: All green
  • Desktop: [Regression] color change for bottom border of legacy Vector's h1 element. 62 failures but the rest are assumed to be intentional (phab:T310197)
  • Echo: 20 failures related to the desktop layout changes

Comparing master against origin/wmf/1.39.0-wmf.14[edit]

Last updated: 6 June 2022

  • Mobile: All green
  • Desktop: [Regression] Spacing between sidebar and TOC has increased. Three failures relating to ULS settings cog. Seems to be a false positive.
  • Echo: All green

Comparing master against origin/wmf/1.39.0-wmf.13[edit]

Last updated: 24 May 2022

All green

Comparing master against origin/wmf/1.39.0-wmf.12[edit]

Last updated: 23 May 2022

Desktop has 14 failures. 8 of these are on the history page and report the reference images having no revision history but those are false positives and is a result of a database schema change that occurred this week and that affected the revision table (Pixel should be more resilient to DB schema changes in the future).

Mobile (5 failed/15 pass): The notification and search icons will show a small shift due to https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Echo/+/793114. This is expected. The settings link was restored to the main menu (https://phabricator.wikimedia.org/T307696) leading to more expected failures in minerva_mobile_mainmenu-open.

Comparing master against origin/wmf/1.39.0-wmf.11[edit]

Last updated: 12th May 2022

All desktop tests are passing.

Mobile (7 failed/13 pass): Mobile tests were introduced but are flaky due to the sidebar animation and layout shift involving the footer logo. The latter should be resolved in #Comparing master against origin/wmf/1.39.0-wmf.12.

Comparing master against origin/wmf/1.39.0-wmf.10[edit]

Last updated: 6th May 2022

22 passed | 38 failed (36% pass)

The failures here were due to expected changes:

Comparing master against origin/wmf/1.39.0-wmf.9[edit]

Last updated: 2nd May 2022

47 passed | 13 failed (78% pass)

  1. [Expected] We’re collapsing things into the more menu at lower breakpoints to make things more predictable. As a result edit icon will be hidden under more menu at lower resolutions now. There was one unexpected bug associated with this on history and Special:RecentChanges which will be fixed by 787801 so that this issue didn't got out with the release.
  2. [Expected] We changed the alignment of logo with table of contents and search with tabs
  3. [Regression] Main menu placement is off on screens 700-1000px