Searching (spell.Suggest) too slow
I run a very large wiki (250,000 pages) and lucene often takes so long to search that the results page will load without showing any results. A subsequent search will show matches, since the results are in lucene's cache.
The problem seems to be with org.wikimedia.lsearch.spell.Suggest which can take up to 15000 ms to complete.
org.wikimedia.lsearch.search.SearchEngine seems to be ok, returning results in ~100ms. Is there any way to speed up/remove the spelling suggestions to increase speed?
Do you have enough RAM for linux to cache the whole spell-check index in memory? If not, you might be hitting I/O which slows down things around 100 times. The size of your wiki shouldn't be an issue (it works fine on much bigger wikis like en.wikipedia.org).
You can also try to decrease the size of spellcheck index. Try settings like these: yourwiki: (spell,40,10)
And then rebuild your spellcheck index. This will index only those words which appear in at least 40 articles, and phrases in at least 10 articles.
