User talk:MWJames

From MediaWiki.org
Jump to: navigation, search


[edit] A barnstar for you!

Original Barnstar Hires.png The Original Barnstar
Thanks for all the help testing and supporting SphinxSearch extension! Svemir Brkic 20:44, 7 September 2011 (UTC)

[edit] Sie erhalten einen Orden!

Vitruvian Barnstar Hires.png Der Technikerorden
Thx for Reporting so many Bugs and Testing our extension. I hope you continue to use our our extension. SBachenberg (talk) 07:12, 21 April 2012 (UTC)
Start a new discussion

Contents

Thread titleRepliesLast modified
Any luck fixing MathJax?208:13, 23 April 2012
Search results sorting514:48, 12 September 2011
SphinxSearch614:48, 28 June 2011

Any luck fixing MathJax?

I had a similar problem to the one you mentioned in the MathJax discussion except involving the tags... I was wondering if you found a more robust way of writing the mediawiki extension for it. If so, please leave me a message. Thanks also for putting together your list of extensions, it's definitely very helpful!

Dc32101:41, 27 August 2011

Since SVN r112835, Extension:Math comes with a MathJax implementation, so it might be that some of the Extension:MathJax problems have been fixed.

MWJames (talk)21:36, 1 March 2012
 

The Extension:MathJax has been updated to include options in handling $ and $$, turning on and off, etc and protecting certain tags, you might have a look...

Dirk Nuyens (talk)08:13, 23 April 2012
 

Search results sorting

Hi James - you may like to try this: Extension:SphinxSearch/Page_rank

Svemir Brkic03:11, 11 September 2011

Thanks for effort, right now we are testing and it looks good. Maybe their should be a note that this change will impact the index time since the main index will take around four to five times longer to build the index.

For the incremental index we changed to DATE_FORMAT(CURRENT_TIMESTAMP() - INTERVAL 12 HOUR, '%Y%m%d%h%i%s') to minimize the incremental index time while running the merge function more often.

/path/to/sphinx/bin/indexer --config /path/to/sphinx.conf --rotate --merge wiki_main wiki_incremental --merge-dst-range deleted 0 0

MWJames05:27, 11 September 2011

There are probably faster ways to gather the same data. For example, the temporary table could be changed into a regular table and updated on a separate schedule. Or it could be replaced with a different kind of join. I need to update some of the larger wikis I am managing to be able to test with enough data.

BTW, why are you merging the two indexes? For me sphinx works just fine when I tell it to use both of them, and merging process needs to load both of them into RAM to merge them, so it is probably slow on a large wiki. What is the benefit for you?

Svemir Brkic11:53, 11 September 2011

For us the incremental index is just a temporary index that contains the last 12 hours of changed content. To avoid a main re-indexing (happen once a month for 2GB wiki db) the merge process is running every 6th hour to store the delta in the main index. The IO for the merge process might be higher but it is relatively fast and does have only a minimal impact on the server workload.

MWJames04:42, 12 September 2011

That makes sense. How long do these 3 processes take in your case (main index. incremental index, and merge)? Svemir Brkic 11:02, 12 September 2011 (UTC)

Svemir Brkic11:02, 12 September 2011

On the test system with the new ranking method

main index = 15 ~ 20 min
incremental index = 30 sec ~ 2 min (depending on existing changes, or template change)
merge index = < 30 sec
MWJames14:48, 12 September 2011
 
 
 
 
 

SphinxSearch

I'm having a bunch of issues with the SphinxSearch extension, which you apparently got running successfully. Can you have a look at my problem, maybe you already fixed it, or know how to get around it.

Jeroen De Dauw13:47, 25 June 2011

First thing that comes to my mind is to us 0.7.2 from the SVN trunk.

MWJames16:27, 25 June 2011

Did that. Figured out the PHP errors, but it's still not working. Updated problem description.

Jeroen De Dauw17:24, 25 June 2011

Just to clarify, I assume you did

  • run the indexer
  • configured the spinx.conf so it is connected to the mysql

Other things that crossed my mind are:

  • I thing there was a change in regards to the ports, so your spinx.conf should say port = 9312 instead of port = 3312.
  • In your SphinxSearch.php file try to find $wgSphinxSearch_mode and changed it to $wgSphinxSearch_mode = SPH_MATCH_EXTENDED2;
MWJames18:01, 25 June 2011

Indexer has ran and the config is correct (I can run the search from command line where it works as it should). Neither ports are getting the desired result (I always get Query failed: connection to localhost:xxxx failed (errno=111, msg=Connection refused) ) and modifying $wgSphinxSearch_mode does not seem to change anything.

Jeroen De Dauw18:56, 25 June 2011

The next thing I remember was that we had some trouble with IP vs localhost. In case the server is referred to as to localhost the best thing is to change it and write as IP such as:

SphinxSearch.php $wgSphinxSearch_host = '127.0.0.1'; $wgSphinxSearch_port = 9312;

spinx.conf >> # data source definition for the main index sql_host = 127.0.0.1 >> # searchd settings listen = 127.0.0.1

MWJames19:13, 25 June 2011
 
 
 
 
 
Personal tools
Namespaces

Variants
Actions
Navigation
Support
Download
Development
Communication
Print/export
Toolbox