With the Cross-wiki search conversation drawing to a close I wanted to reflect upon the task and how what we did reflects in the sections outlined here. This is a bit of a ‘postmortem’ on how the TCG guided us and what we learned along the way. I hope it’s valuable to other liaisons and product teams. I also hope that it doesn’t sound too much like I’m patting myself on the back. :) Keep me honest if it does. I encourage others to do the same reflection with their work.
When and how
I think by having the conversation early we didn’t get caught in too much ‘last minute’ work. Working with the Product Manager and engineers we defined deadlines by working backward from the biggest date. For us it was “We want to give the community members interested in search enough time to respond”. Our aim was for a month (set roughly on July 19 (https://etherpad.wikimedia.org/p/inter-wiki) of discussion time. Since the last day of the quarter was at the end of September we aimed for getting the communication ready (in messaging and preparedness for translation) by the end of August.
I don’t have a good gauge to know if a month was appropriate, but no one was upset at it being too short :) I do think that a handful of weeks would be too short for a task of this importance/size. I also think we could have done a bit better job communicating reminders about participating.
A note on coverage - maybe not TCG specific, but product plans should account for sick time, vacation, professional events, and just plain emergencies. I was out for a week in the midst of starting the conversation and made sure to reach out to both the product team and my peers to make sure the work moved forward.
We had translations in our plans all along, including a week of time after finalizing the communication to ask for translations. As reflected in the TCG, planning for translations helps greatly in being honest in our goals to include all communities.
We had the post to the various Village Pumps translated into 10 languages other than English.
The main page was only translated in to Ukraine. I should have pushed for more translations in both the message and conversation. A hard thing to balance for me. I don’t want to be too burdensome to our volunteers (or to fellow staff in my absence).
There was a small discussion on which wiki to post the request for feedback. Meta seemed most appropriate as the changes to search will affect all projects. However, considering the Discovery department has an overwhelming amount of documentation on MediaWiki the decision was made to host it there.
I think more important than “where will this live” is “where will you share it”. We used the Village Pumps and mailing lists as our main drivers back to the conversation. With past Discovery discussions we’ve stuck to the more technical-focused mailing lists (discovery-l, wikitech-l). Since this task reaches well into the non-technical side of things we also included wikimedia-l.
Because the conversation was grouped around “Should we make this change?” and “How should this change be designed?” we created a sub-page specifically for the design aspect with a few ‘teaser’ images on the main discussion page. I think this helped keep the introduction and ‘ask’ a little easier to digest.
What to say
Humorously our request for comment was three sentences on what will be a significant change to the appearance and functionality of search across all projects. When Deb wrote the message I couldn’t think of much to add; or remove. To add to what the TCG says regarding ‘What to say” I would add, “Be as succinct as possible”. Short sentences that are to the point go much further than long sentences that bury the focus.
Speaking of focus, we tried to focus the questions around a few topics. We approached the communities with five big questions. However, the first question had 10 sub notes. Probably could have been a more succinct there. :)
At the same time wanted to prompt discussion with ideas. I’m of the thinking it’s easier to get feedback when you have some sort of prompts vs a blank talk page. My advice for future projects is to keep the focus around the conversation with 2-3 big questions for folks to ponder. Don’t say, “What do you think?” instead say “What do you think about A, B, and C?”. Populate the talk page with those topics and encourage other topics to be included.
What to expect
In past lives I’ve worked at large organizations spread out across multiple geographies. Getting everyone - who is paid to work there - to respond to consultations always proved problematic. When applying expectations to an even larger and more diverse group of folks volunteering their time I am pleasantly surprised when any number of folks show up. :)
However, again I would have liked more voices. We had less than a dozen voices in the talk pages about of a few hundred page views and mailing list/Village Pumps with even higher viewership. I think a change of expectations around how frequently we reach out during a consultation should be discussed. Posting once and waiting for folks to show up is not good enough. Perhaps ‘check in’ reminders or further channels could be utilized during a push to get more folks to participate.
To be clear, I do appreciate those that did show up and thank them for their time and thoughts.
These are just a few thoughts I had after working on this task during the last quarter. I'm happy to answer any questions and appreciate feedback.