In Paramanand's questionnaire response, he suggests that the effects of the EoQS should be studied. This made me realise that I don't really know anything past the "theory" of the EoQS since its announcement (28th April 2021), and I guess this is because I haven't been actively trying to enforce it (I spend my 'moderation time' more on editing and reviews), I don't frequent CURED, and I have not (yet?) been banned by it. Really, my main exposure to it is via others' meta posts. I only sometimes notice EoQS offenders "in the wild". I also suspect certain high-rep users no longer post, or even have an account.
There are the posts 2020: a year in moderation that give summary statistics on moderator actions (community moderation and otherwise) Is it possible to similarly get a rough idea on what and how much has happened since the EoQS began to be enforced?
Some ideas off-the-cuff:
number of comments (on main) referencing the EoQS
number of answers/questions deleted/closed due to enforcing the EoQS.
number of suspensions due to enforcing the EoQS (possibly split into low/high rep, and duration of suspension)
number of users requesting to close their account citing disagreement with the EoQS
Do high rep users post answers less frequently?
Is there some sort of metric to see how much time the EoQS is taking out of moderators? (This would also be nice for the upcoming new mods to know what they're getting into.)
Are users that receive multiple EoQS comments downvoted more?
And of course, the effect of the EoQS. Any way to quantify the following questions?
- Do we have significantly less low quality Q&A pairs in the system than we would have without the EoQS?
- Do we have significantly more good Q&As in the system than we would have without the EoQS? (i.e. did the low quality questions get improved into good ones)
- Has the situation with duplicates improved?
Of course, the easier to obtain the data, the better; the mods are busy enough as is (hence the election). But I suspect many of these are not so easy with merely SEDE because low quality answers (with said comments) are more likely to be deleted (and hence deleted off SEDE IIRC).
One rough measure I suppose would be the difference between the 2020 and 2021 "a year in moderation" numbers, when 2021's comes out, but there are many confounding variables.