Talk:WMDE contract offers/Store interwiki-links in the database

I'm not sure adding an interwikilinks table is a good idea; adding an interwiki field to the {page,template,image}links table would be a better idea IMO. An rd_interwiki field in the redirect table has been proposed already (bug 14418, has a patch but is waiting on the schema change rotation script thing to go live AFAIK). --Catrope 16:24, 4 April 2009 (UTC)

List of broken references.

• Create a special page that shows all broken references to pages on other wikis, if possible

Everything is possible, the question is at which price, or performance degradation ;-)

• this will be possible only for wikis for which the database can be accessed directly.
  1. How useful is it then?
  2. How about querying the wikis in question via their api?
  3. How about querying websites via http head request, maybe solving redirects, and if it is a 4xx or 5xx, it's a broken link? Maybe analyse the "good" results futher, and even fetch websites that redirect to a common error page, or search page w/o a 404?
  4. How about chaching the results?
• Caveat: there are nearly 800 Wikimedia wikis now. It's probably best if only one target wiki can be queried at a time.
  1. Not even that. Target wikis may be, and some are, outside the scope of the WMF.
  2. Easy when using the api interface.
• Caveat: there are three database clusters Wikimedia wikis. Doing this across clusters will probably not be possible.
  1. Again , how useful was that list?
  2. It can be had via API.
  3. When such these lists may be cached and only occasionally replaced by a new one, why not generate them on the toolserver? It has at least structural data of all WMF wikis. --Purodha Blissenbach 00:30, 10 April 2009 (UTC)