Search/Old/status

Last update on: 2013-06-monthly

2013-03-11
Ram made an update to reduce noise in log files; this has been reviewed and merged. Chad made an update to remove unused code and reduce build-time warnings; this is under review. Ram and Antoine worked on getting search updated on the Beta cluster. Ram created an initial patch for fixing, which was reverted to make sure that the deployment would go smoothly, and that backwards-compatibility was taken into account.

2013-03-15
The noise reduction patches are now in production and ops reports that the logs are now much cleaner. Ram has pushed a patch to fix the problem with updates being lost sometimes; it awaits review. Most of Chad's cleanup patches have been merged. Ram is instrumenting the code with better diagnostics so that we can troubleshoot search issues better. 

2013-03-monthly
Search deployed to Beta Cluster. Search code instrumented for better troubleshooting and identification of issues, and work is underway to add PoolCounter support. Plan for April to make search updates more robust.

2013-04-monthly
Code has been instrumented (and will soon be deployed) to log more data to allow root cause analysis of the spurious "Zero results" issue. Some log analysis was also done. The Puppet configuration on beta was updated to limit lucene-search-2 memory usage on Labs.

2013-06-monthly
Work has pretty much shifted from supporting MWSearch/lsearchd to investigating and implementing Solr. Nik and Chad have begun writing an extension to implement Solr searching for MediaWiki, and we've gotten a lot of the initial basic functionality completed. Peter and Andrew will be handling the operations tasks for the new setup. Initial operations tasks will involve packaging Solr 4 and working with Chad to puppetize the whole design. Additionally, we're going to do some investigation into ElasticSearch, as it's been suggested as an alternative to Solr.