User:OrenBochman/Search/Test Plan

=Overview=

Functional Test

 * Testing Indexing
 * Indexing of MediaWiki source
 * Indexing of hypertext source
 * Indexing of external links
 * Testing Update Mechanism
 * Requires a robot that uploads content into the test Wikipedia installation.
 * Test new pages added
 * Test existing pages are updated
 * Test Indexing propagated from indexer to searcher
 * Test Indexing propagated from searcher to replication.
 * Integration tests of component.
 * Tests OI Repository is online and working.
 * Tests Search UI is online and working.
 * Offer search results from Sister Projects
 * Tests Search suggestions are online and working.
 * Tests Search extension is healthy.
 * last update in special pages
 * Test Index is not corrupted.

Relevance Test

 * Checks to what degree ranking is altered overtime (by various configuration).
 * Select N=100 queries.
 * Store to 10 results for 100 queries.
 * Associate these with a ranking profile. (Query cooking + Analyzer + Linguistics etc).
 * Order of results is consistent across multiple hosts

Benchmarks

 * Benchmark indexing.
 * Benchmark testing.

Regression Tests
tests that bugs from the past do not return