Content translation/QA

Persona based testing

 * New user
 * Existing user
 * Returning user testing.

Browser testing

 * Firefox
 * Chrome
 * CBT options can be used.

Language pairs

 * Group the language pairs to sensible sets and test a sample from each group- end to end testing.
 * Language pair with mixed directions.
 * Language pair without MT.
 * Language pair with MT (internal service).
 * Language pair with MT (external service).

Time/resource management ideas

 * Complete the whole test plan once in a week time- 5 days.
 * Focussed task based testing - one per each task.
 * Master stability testing - focussed on the features added and sanity testing prior to branching.

Resources

 * Labs:
 * CX (http://cx2.wmflabs.org/index.php/Special:ContentTranslation) is always on master (Delay 30 minutes).
 * cxserver (cxserver.wmflabs.org/v1) is always on master.


 * Beta:
 * CX (http://en.wikipedia.beta.wmflabs.org/wiki/Special:ContentTranslation) is always on master (Delay 30 minutes).
 * cxserver (https://cxserver-beta.wmflabs.org/v1) is manually updated by cxserver/deploy repo.


 * testwiki (https://test.wikipedia.org/wiki/Special:ContentTranslation) updated every Tuesday.


 * cawiki, hewiki in Production updated every Wednesday.


 * cxserver (https://cxserver.wikimedia.org/v1) is updated manually using cxserver/deploy repo.

Depth of testing
Table: with and without content on all cells, very wide tables, very large tables, tables with images, tables with Maths/Science formulas, Weird tables, Tables with different writing direction, Tables in RTL, Tables in CJK. Lists. Long lists etc Links can have full list - new, red, delete, external link, adaptation (Pau has a list of interesting language related complicated), Search in Links. Search in Indic/RTL/CJK languages. IME testing x ULS changes.. - enabled/disabled/changes Categories - adaptation is matching, Removing category is OK, Wikidata - new article is being added to wikidata. Menu - Everything in CX menu is showing correctly or not; RTL; Check new changes in text etc. Campaign: Outside beta:cxstats, specialcx, newuser Inside beta:cxmenu Notifications: 1, 10, 100 2nd translation suggestions Entrypoint(s) Interlanguag links Campaigns Suggestions: Featured articles Starring Discard suggestion Accept suggestion Duplicate suggestions Repeatation of discarded suggestion Suggestion appears for existing articles Suggestion appears for articles in Draft/In progress MT Services Providers are active Default providers selected Translations are actually happening Revert to Source RTL MTs Mix language MTs Paragraph clearing, using source text etc. Publishing AbuseFilter Test Wiki specific AbuseFilters. Publishing failures Publishing button behavior Publish on existing article. Publish in User namespace. Publish on article without Wikidata link to source article. Publish article after long time (And check formatting) Formatting Format toolbar IME Local settings from Wiki Combinations from user. Writing after bold, superscript, links etc. References: Add/Delete, Refcard display Draft/Saving/Restoration Draft is available. Draft save Draft deletation Restore article from Draft. Format Test when Source article is changed. Sections are OK in Draft. Post publishing errors Unnecessary tags Invisible characters, spaces, line breaks Reference adaptation, Reference duplication Inline templates Retranslation of already published article Immediately after publishing complete restranslation (ignoring the article exists warning) - loading of any existing translation Warnings are displayed correctly Test newly setup Wikis (Example ady.w.o)