Discovery/Status updates/2019-04-08

This is the weekly update for the week starting 2019-04-08

Search

 * New WikibaseCirrusSearch code is deployed and enabled on all wikis, including Wikidata & Commons.
 * We re-indexed all Greek, Turkish, and Irish-language wikis with better handling of Greek accents, Turkish İ/ı , and Irish initial mutation when lowercasing searches in quotes.
 * We noticed that indices can move to readonly state when disk space is low and needs to be reset manually once disk space is available again, so we made it a cookbook
 * David wrote a patch to help with an exception from CirrusSearch/Sanity/Checker (cannot fetch ids from index)
 * We fixed/finalized more things with the ES6 upgrade:
 * Create checks that alerts on cirrussearch update lags
 * Elasticsearch 6: the classic similarity is deprecated
 * Setup elasticsearch on cloudelastic100[1-4]
 * Rack/setup/install cloudelastic100[1-4].eqiad.wmnet systems
 * Erik converted mjolnir from KafkaRDD to direct kafka-python usage, because KafkaRDD in pyspark only supports the 0.8 api

Wikidata Query Service

 * Deployed patch to fix an issue in Blazegraph workbench
 * Working on improving cache behavior of Updater

--
 * View all open tickets related to Discovery.
 * Looking to get involved? See tasks marked as Easy or volunteer needed