Selenium/Ruby/Workshops/Search features

10min video with basic instructions: youtu.be/Kad3EUM4GdM Etherpad to document progress: http://etherpad.wmflabs.org/pad/p/Browser-automation

WHAT: Writing Wikipedia search scenarios in plain English for our automated testing process. Let's feed the Test backlog with descriptions like this:

Feature: Search

Scenario: Search suggestions Given I am at random page When I search for: main Then a list of suggested pages should appear And Main Page should be the first result

WHEN: We will start with 30min demo streamed on Wednesday, March 13, 2013 at 17h UTC and we will be helping volunteers during the rest of the week. This is an ongoing activity: you can arrive / leave at any time.

WHERE: IRC channel. After joining on IRC, say Hello browser testers! and we will welcome you with instructions and a simple task. chrismcmahon, zeljkof and qgil will do their best covering timezones. You can also use the Discussion page to ask any questions.

WHO: Anybody interested, including you! The only requirement is basic level of plain English in order to describe the features to be tested automatically. It is that simple.

WHY: The Wikimedia Foundation engineering team is working on several Search improvements. Automated browser tests do find bugs!

See also How to contribute.

This is a weekly QA activity organized by the MediaWiki Group Browser testing. Join us!

Focus
Here is a list of open bugs we are likely to fix soon that we want to test automatically:


 * Search for simple text misses some results
 * Incorrect UTF-8 processing
 * Search ignores user settings
 * Search does not find pages created with  tag. (Could this be testing in English?)
 * Search results should always be shown in the same order
 * Accents should be disregarded in Search

We could use regression tests for Search features also:


 * Umlauts and accents are disregarded in search
 * Some ligatures match the separate letters. For example, a search for aeroskobing will find pages containing Ærøskøbing (ae = Æ)
 * It is not possible to search for the string |LT| (letters "LT" between two vertical bars); all articles with "lt" will be returned.
 * Ignore parentheses except for exact matches: Credit (finance)" will return articles with the words "credit" and "finance", ignoring the parentheses, unless an article with exact title "Credit (finance)" exists
 * A phrase in double quotes returns exact matches
 * Etc.

There are more examples in Bugzilla.

Both desktop and mobile browsers need Search tests.