The Signpost

File:Walther WSR-16 Pin-Wheel details.jpg
Mister rf
cc-by-sa-4.0
15
1
425
Arbitration report

Analyzing commonalities of some contentious topics

The Signpost invited further commentary and explanation concerning input given by Barkeep49 at the Palestine-Israel articles 5 case. He put forth the hypothesis that we would see the most challenging reports sit open longer than normal (indicating a problem) and/or have abnormal amounts of words (become too unwieldy to close) and/or have an unusual number of admins (not enough admins and/or "too many cooks in the kitchen") and/or have disproportionate participation by parties (which could have been either a response - they were drawn to the hard reports - or a cause - their participation cause reports to become hard). We can also see that PIA cases at AE don't look statistically different from reports in other topic areas. This Arbitration report will show the data that was gathered to support or potentially disprove the hypothesis. – ed.

As part of the ongoing Palestine-Israel articles (PIA) 5 case, I (Barkeep49) conducted an examination of of all 2024 Arbitration Enforcement requests closed between January 1 and December 16. I did so anticipating one or more of the following hypotheses would be true:

  • PIA reports at AE would be open longer than normal, or failing that, at least the most difficult PIA reports would be open longer than normal
  • The most difficult PIA reports would be longer than normal
  • There would be a difference in the number of admins at the most difficult reports

With difficult reports roughly correlating to those which were ultimately referred to ArbCom and caused the opening of the case.

What the data showed

The cases that ultimately caused referrals were not the ones open the longest. They had a higher, but by no means abnormal, number of Admins who commented compared to others. PIA cases were not unusual in the length they were open either, though they were abnormal in representing a huge percentage of overall AE cases for 2024.

2024 AE cases by topic area
Scope # of cases[a] AVERAGE of Days MEDIAN of Days MAX of Days
AA 7 7.29 7 11
AE 4 4.25 3 9
AP 13 8.08 8 19
ATC 1 19.00 19 19
BLP 7 7.00 6 16
CAM 5 2.20 3 4
COVID 1 12.00 12 12
EE 9 5.11 3 14
Falun 2 7.00 7 12
Gender 18 4.44 4 24
GMO 1 1.00 1 1
Info 1 10.00 10 10
IPA 14 6.50 3 22
MOS 1 19.00 19 19
n/a 3 0.00 0 0
PIA 81 6.02 5 30
PS 10 6.50 2.5 26
SRI 3 7.67 6 12
Troubles 2 10.00 10 11
Yasuke 1 2.00 2 2
Totals 173 6.09 5 30
  1. ^ Some cases were filed under multiple areas. For topic areas these cases are listed under both areas, while the totals only count those cases once.

Instead, there appears to be far stronger evidence to suggest that AE struggles with handling the conduct of more than 2 editors (the filer and the editor being reported) at the same time.

This is sometimes inevitable when dealing with an issue like WP:TAGTEAMING but when it happens it does seem to make it harder for AE to reach a consensus. This is what unites the cases referred (PeleYoetz/האופה, which were the first referral, and the two Nableezys, which were the second referral) and the other cases in PIA (IntrepidContributor, Makeandtoss and M.Bitton, and Galamore, which were not referred but which were open an unusually long time (they were 3 of the 5 longest cases to resolve at AE in 2024 across all topic areas). In fact, at 2 of those, I think what allowed them to ultimately be resolved was to focus on a smaller set – essentially 1 or 2 specific editors – and then "everyone else involved" as a single entity.

So the data showed that basically all of the hypotheses were incorrect.


+ Add a comment

Discuss this story

These comments are automatically transcluded from this article's talk page. To follow comments, add the page to your watchlist. If your comment has not appeared here, you can try purging the cache.

Do you have this data in a neat easy to use spreadsheet? Volunteer Marek 07:03, 17 January 2025 (UTC)[reply]

@Volunteer Marek Copy-and-paste this signpost URL into https://wikitable2csv.ggor.de/ JayCubby 14:21, 17 January 2025 (UTC)[reply]
Thanks. But I was more wondering about a spreadsheet that lists every individual case, admin active etc. All the data, not just the end result summary. Volunteer Marek 14:40, 17 January 2025 (UTC)[reply]
I can look into it. Be warned that when I offer to look into a thing of a technical matter, I tend to utilize ChatGPT's SQL or Python code and waste Google Colab's generous resources. JayCubby 15:15, 17 January 2025 (UTC)[reply]
The admin active information for PIA is found in my evidence section at WP:PIA5. While a spreadsheet exists for the AE data I made it quick and dirty to help me get the numbers and not in a way that would work well for sharing with others. I hope Jay's efforts are successful (FWIW I spent a little time seeing if I could get an LLM to spit out a script for me but ultimately decided it was going to be faster to just do the work manually). Best, Barkeep49 (talk) 16:46, 17 January 2025 (UTC)[reply]
Thanks, that’ll work. I haven’t been following the case so didn’t see it. Volunteer Marek 17:14, 17 January 2025 (UTC)[reply]

















Wikipedia:Wikipedia Signpost/2025-01-15/Arbitration_report