The Signpost

Special report

ArbCom election—candidates’ opinions analysed


It’s election season again: voting will soon open for the 13th annual election of the English Wikipedia's Arbitration Committee. In a repeat of last year’s election, there are nine vacant seats on the 15-member committee, eight of which will carry two-year terms and one a one-year term. Following two withdrawals, there are 22 candidates, up on last year’s 18; five of them have already served on the Committee for at least one term: LFaraone, GorillaWarfare, Kirill Lokshin, Thryduulf, and Casliber. Many eyes will be on the number of voters, which last year shrank precipitously by more than a third, from 923 to 593.

Participation in ArbCom elections, 2008–14. Voter numbers are blue (left y-axis); candidate numbers are red (right y-axis).
As in previous ArbCom elections, the electronic interface SecurePoll will be used, with support–neutral–oppose ternary choice and an unusual S/S+O formula. In the 2013 election, the use of this system made a difference to who was elected compared with the number of supports alone, and last year changed who was given the one-year term.

This year has marked one of the most fractious in the history of the Committee, in which judgment voting patterns have at times shown mild evidence of the formation of blocks of arbitrators, depending on the theme. There were several drama-infused cases, including the Gamergate case, which attracted unfavourable outside press coverage; gender-related cases appear to be a point of divergent viewpoints among the arbitrators. The current election will influence whether the Committee can regain cohesion and weather external shocks, including emotionally charged cases and critical coverage by external news outlets.

Excerpts from candidate statements:

Am I suitable to work here as an arbitrator? I have no idea.

Well, this is about the last thing I ever thought I’d do here.

Fuck it, I'll be the first to throw my hat in.

I don't want ArbCom to be regarded as a death panel.

So I was an editor, if not a very hardworking or ambitious one.

We must clean our house, lest those who could advise and assist us dismiss Wikipedia as a nest of boobies.

ArbCom has encrusted itself in mock-judicial trappings.

My opinion of the current committee’s Infamous, Thoughtless, Careless and Reckless handling of Gamergate received some attention.

ArbCom requires more innocent merriment, and I’ll do my level best to supply it.

I consider myself pretty up on cultural differences, having spent extensive time working in ... Canada, US, Australia, and Mongolia.

As well as reading the candidate statements and question pages, community members have written 15 voter guides, almost as numerous as the candidature. Against this, however, the Signpost is providing a different angle by presenting the results of an emailed survey to candidates on both their personal qualities and their views on ArbCom-related issues. This is the methodology we have used twice this year in our coverage of WMF Board and FDC elections. With so many candidates, it is a way to provide voters with comparative data gathered on a large scale in isolation, eliminating the "herd" effect in which candidates' responses are influenced by those of their colleagues. This is at the expense of reducing candidates' views to numbers, so we invited short statements to give respondents the opportunity to state more nuanced views—taken up by only a minority. The survey and the writing of this story was designed and supervised by the Signpost's Editorial Board; editor-in-chief Gamaliel was excluded from the process because he is standing in the election.

The survey

There are several findings of interest. The candidates overall think that cases take too long, that case procedures should be streamlined, and that it's too hard for community members to extract the important messages from ArbCom’s judgment pages. They are satisfied with the voting system in the election, and believe the WMF should take more responsibility for minor issues. There is mild consensus that ArbCom's scope to manage excessive behaviour should not be widened, and that off-wiki outing is never acceptable. Consensus is less clear on transparency issues. The candidates are significantly divided on Gamergate and gender treatment.

We received 18 responses; one candidate, Kirill Lokshin, did not respond; Kelapstick apologised that he's "in a jungle" with bad connectivity; two more refused to participate on the grounds that the questions "require candidates to reveal information that they chose to withhold in their nominations or chose not to reply to the users' questions" (Kudpung), and were not "transparent" (NE Ent). Hullaballoo asked to withdraw his responses well after the announced copy-deadline, and after the data analysis had been done, a request we declined. One of the candidates who responded, Samtar, has since withdrawn.

We used a seven-number Likert scale, exploring a six-point response space from 1 to 7:

Each candidate was invited to put a number against each of 20 propositions, and were informed that blanks would be counted as "4" for statistical purposes (these are marked red in the table). We have abbreviated candidates' usernames for reasons of space; those who have served on the Committee are marked with an asterisk. The full wording of the propositions appears at the bottom of the story. Averages and standard deviations appear first;1 then net positives (5–7) and negatives (1–3), which disregard the strengths of the responses to focus merely on which side of neutral candidates lie as a whole.

Key to the abbreviations of the candidates' names in the first row of the table below:

Proposition Avg. StDev Net pos. Net neg. OR TT M G CL* W Cal KG MB K D GW* LF* H RF T* HW S
 
(A) I have a record of minimising drama 4.9 1.6 13 4 7 6 3 5 6 5 6 4 1 6 6 2 6 5 6 5 3 6
(B) I favour strong over light sanctions 3.4 1.3 6 8 2 2 3 6 3 5 5 3 4 4 4 5 2 2 1 4 3 3
(C) I'm prepared to manage difficult editors 6 7 7 7 6 7 6 7 4 6 5 6 7 7 7 7 6 6
(D) Drafting judgments in plain, simple language is my strength 5 5 6 6 5 6 6 6 7 6 6 6 5 7 7 3 6 7
(E) ArbCom's scope to manage excessive behaviour needs to be widened 3.1 1.7 5 11 2 2 6 6 4 5 2 5 2 5 2 1 4 3 1 2 2 2
(F) All case evidence should be on-wiki 3.4 2.1 7 10 2 6 6 2 2 2 1 1 1 4 3 1 2 5 6 6 6 5
(G) Arb discussions on cases should be on-wiki 3.7 1.7 6 9 4 5 5 2 3 3 3 1 1 4 4 2 3 6 7 3 6 5
(H) Arb burnout is a major problem to address 4.9 1.3 10 2 6 4 7 7 4 4 6 4 7 3 4 5 6 4 5 5 3 5
(I) Judgment pages: easy enough for community to get the messages 3.0 1.6 5 13 1 5 5 3 5 3 3 1 1 3 2 3 5 2 2 6 1 3
(J) Accept fewer cases, leave more for AN/I etc 4.3 1.6 8 6 5 7 6 5 3 5 2 3 4 4 6 2 2 6 7 4 3 4
(K) Cases need to take less time 5.7 1.2 16 2 7 7 6 5 6 3 5 7 6 6 6 5 6 5 7 6 7 3
(L) Case procedures need streamlining 5.2 1.4 13 4 7 6 6 3 6 5 5 7 3 6 6 6 3 5 6 4 7 3
(M) ArbCom was at its worst in handling Gamergate 4.2 1.6 8 6 4 4 2 6 6 2 5 3 7 5 4 5 2 6 4 2 3 5
(N) I was satisfied with the Gamergate judgment 3.4 1.5 5 10 2 4 6 2 3 5 3 3 1 3 5 3 4 2 4 6 1 5
(O) ArbCom should disregard off-wiki evidence 3.3 1.7 10 4 2 6 4 3 2 6 2 1 1 4 2 5 3 6 4 4 1 3
(P) Off-wiki outing never acceptable 4.7 2.1 11 5 4 4 7 6 3 7 6 3 1 5 1 7 5 7 6 6 1 6
(Q) ArbCom has treated men more sympathetically than women 4.6 1.8 8 6 6 4 4 7 3 3 5 7 7 4 4 6 2 7 3 3 6 2
(R) The WMF should take more responsibility for minors issues 5.8 1.4 14 2 5 7 7 6 7 6 7 7 4 6 5 7 7 4 3 3 6 7
(S) I'm happy with Audit Subcommittee arrangements 3.1 1.5 2 9 2 4 6 4 4 5 1 4 3 2 4 3 1 3 1 1 4 4
(T) I'm satisfied with the ternary voting system for ArbCom elections 5.4 1.5 14 2 6 7 6 5 5 5 7 2 3 6 4 7 6 5 6 7 4 7
Proposition Avg. StDev Net pos. Net neg. OR TT M G CL* W Cal KG MB K D GW* LF* H RF T* HW S

Making sense of the data

Our motivation was mainly to survey attitudes to ArbCom-related issues by the group as a whole (this is a highly relevant cross-section of the community—those who put themselves forward for election). However, before they cast their votes, editors may be interested in scrutinising the responses of individual candidates.

Data interpretation can never be 100% objective, and the Signpost welcomes critical comments and discussion on the talkpage below. Propositions C and D we regard as likely to attract a higher level of public-relations calculation by candidates, which explains the narrow, positive range (who would admit they're unprepared for managing difficult editors or can't write clear judgments?); statistics are less relevant here and are not included. Proposition A might have been in the same class, except that the focus is on evidence (candidates' "record"), with responses ranging from 1 to 7. B is the hanging judge question, which might attract more scrutiny from voters: eight favour light over strong sanctions, four sit on the fence, and six favour strong sanctions (not surprisingly, only one of them going beyond mild agreement).

Let's deal first with the five propositions on which there appears to be clear consensus among the candidates:

On four questions there is only a modest consensus:

Consensus is less clear in two related questions about transparency, especially the second one:

On five questions, the candidates show no consensus:

Voting

The two-week voting period will open at midnight on Monday 23 November (although some voters may be confused as to whether this refers to midnight start or end of Monday). Voters are advised that the arithmetic of the ternary system means that opposing all candidates they are not supporting, rather than voting neutral for them, is a more powerful confirmation of their supports. An election feedback page has been established.


1 Standard deviations are a measure of spread. They can be roughly visualised as the space that contains a third of responses above the average and a third below it. If 5.0 were the average and 0.5 were the standard deviation, two-thirds of responses, roughly, fall within the range 4.4–5.5. The larger the standard deviation, the more divergent the candidates' views.

Full wording of propositions:
  • (A) I have a record of minimising drama in emotionally charged onwiki situations.
  • (B) I see myself as being on the tough side of the spectrum, favouring strong over light sanctions.
  • (C) I’m prepared to manage difficult editors under the radar where privacy is imperative.
  • (D) Drafting cases in plain, simple language will be one of my strengths as an arbitrator.
  • (E) The current scope of ArbCom’s powers to manage excessive behaviour needs to be widened.
  • (F) Case evidence should always be onwiki for the sake of transparency.
  • (G) Discourse among arbitrators about a case should not be conducted behind closed doors.
  • (H) Arbitrator burnout is a major problem and the Committee should address it urgently.
  • (I) ArbCom’s judgment pages are easy enough for community members to extract the important messages behind judgements.
  • (J) ArbCom should accept fewer cases and leave more to community forums such as AN/I.
  • (K) Cases generally need to take less time.
  • (L) Case procedures need to be streamlined.
  • (M) We saw ArbCom at its worst in the way it handled the Gamergate case.
  • (N) Given the difficult circumstances, I was satisfied with the final judgments on Gamergate.
  • (O) ArbCom should disregard evidence posted off-wiki in its judgments/sanctions.
  • (P) Off-wiki outing of a Wikipedian is never acceptable, regardless of the circumstances.
  • (Q) ArbCom has tended to treat men more sympathetically than women.
  • (R) The WMF should take more responsibility for managing issues related to editors who are minors.
  • (S) I’m happy with the current arrangements for the Audit Subcommittee.
  • (T) I’m satisfied with the oppose–neutral–support voting system in the annual election.
Editor's note: Andreas Kolbe and Rosiestep made important contributions to help frame the questions as well as format the data on this page. Editor-in-chief, Go Phightins!, was also involved in the formulation of the questions and curation of the data. However, Tony1 deserves the bulk of the credit for this coverage. Questions or concerns can be directed to the Signpost talk page or the editor-in-chief's talk page. Thank you.

















Wikipedia:Wikipedia Signpost/2015-11-18/Special_report