Stack Exchange Network

Stack Exchange network consists of 175 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers.

Visit Stack Exchange

Questions tagged [review-audit]

Test items in review queues that are designed to help new reviewers hone their moderation skills, while nudging more experienced users that don't seem to be paying close attention to what they're reviewing.

87
votes
3answers
2k views

STOP! Look and Listen.

I was reviewing a bit and ran into a bad answer. Usually I open the question to see it within context (I know this is not the supposed course of action) and so I did. The bad answer I was reviewing ...
61
votes
2answers
909 views

Audits: this is getting ridiculous.

I was looking at the suggested edits list. There was this question where I couldn't make sense of the edits that were shown to me. So I click on "improve" to see the question properly, as the ...
50
votes
44answers
2k views

Examples of poor review audits

Since threads about review audits seem to be turning up fairly frequently now, it seemed like a good idea to open a thread to collect examples of those audits where people failed but feel like they ...
31
votes
1answer
831 views

What should one do if they see extremely fast reviewing?

Looking through the logs of the review queues, I sometimes see very long chains of reviews from the same user, frequently all with the same decision (leave open, no action needed, looks OK, etc.); ...
28
votes
2answers
341 views

Try to comment: Fail review audit

I know the review audits aren't without their flaws, but with this review: https://math.stackexchange.com/review/first-posts/109542 it should be clear that something is not right. As usual, the vote ...
25
votes
2answers
647 views

Is it me or the audit?

Questions about audits have been asked many times before however mine is regarding this specific case. The answer was one blob of LaTeX with no explanation and I thought that it would be better ...
25
votes
0answers
495 views

Demotivating test reviews

Some of the posts I review as candidates for deletion are test items. After I duly pass or condemn such an item, I get the message Congratulations! This was only a test, designed to make sure you ...
24
votes
2answers
333 views

Should review audits be disabled (pending improvements)?

Last August, so-called "review audits" were introduced on MSE. These are fake review samples added to the review queues, designed to catch those users who (in a dash to get a badge) practice mindless ...
22
votes
1answer
489 views

Can we take famous questions out of the “review audit” system?

Earlier I saw a first post come through the review system titled "Are mathematical articles on Wikipedia reliable?" Now, since I'm genuinely reviewing and not thinking that the system is throwing fake ...
22
votes
1answer
242 views

Preview of a proposed edit?

Is there a way, when reviewing a proposed edit, to preview it exactly as the edited text would appear on the site? I maybe wrong but I think that at Tex/LaTeX Stackexchange you have the option to see ...
21
votes
1answer
556 views

If a question is interesting, is this automatically context?

I recently failed the following review audit. I voted to close for "no context," but the system said it was a good question. https://math.stackexchange.com/review/close/392013 The irony here is ...
21
votes
3answers
640 views

Why should I review?

This is the second time I hit the following (or similar) message, but I don't really understand what I did wrong. STOP! Look and Listen. This was an audit, designed to see if you were paying ...
20
votes
0answers
605 views

Definition of spam redux: a review audit fail I'm proud of!

The notion of what constitutes spam in Math.SE posts has been discussed before, with links to appropriate Meta.SE posts covering the same ground. With that in mind, please (if reputation permits) ...
19
votes
2answers
462 views

Do we want to enable the review auditing feature that discourages robo-reviewing?

From Grace Note's comment in this answer, I was surprised to find out that the auditing system that is supposed to hinder robo-approvals is not active on math.stackexchange. I remember seeing this a ...
15
votes
2answers
331 views

“tests” in reviews

I had a very minor question concerning the "reviews" that we are asked to make (vote to close, to leave open , approve edits ...); more precisely, about the "tests" that are sometimes made. When you "...
13
votes
1answer
301 views

Should I vote to reopen a closed post that was closed for the wrong reason

I was reviewing the reopen queue and came across a question that was closed because it was detected by the system as spam (some wording similar to that). The post was not apparently spam, but a very ...
13
votes
1answer
501 views

What to do when you don't agree with an audit

I just had the unpleasant experience of reviewing this question, where this close review was an audit to see if I was "paying attention." I was about to vote to close, but then I noticed that only ...
13
votes
0answers
139 views

Types where Comments are allowed (or not) in Review Audits

My recently failed review audit got me to wondering which review audit types allow commenting and which don't allow them but advise you of this. If you do a volume of reviews, you've probably seen ...
13
votes
0answers
154 views

Why give me something in the review queue where the only option is “skip”?

While reviewing I came across . My only option was to "skip". Why did this show up?
12
votes
3answers
240 views

Is there any way to disable review audits?

Those automated things try my patience... and I'm supposed to click on "I understand" to agree? With no alternative? I realize that this is by far not the worst trial of my patience I'll encounter in ...
11
votes
1answer
356 views

What happens if you fail the review audit several times in a row?

What happens if you fail the review audit several times in a row? Do you get suspended from reviewing? I have failed 4 review audits in the close vote category in the last few days and since today I ...
11
votes
2answers
707 views

I failed an audit, and I don't understand why.

I was reviewing some close votes and there came a question which was marked as "primarily opinion based". But obviously it is not. However, I thought the question should be closed for some other ...
11
votes
0answers
202 views

Test reviews counted as reviews

For close votes for instance, we are limited to 20 reviews per 11-12 hours, which is not a lot. However when you have a test close vote (the ones designed to check that you're not voting without ...
10
votes
0answers
61 views

Audit answers copy an existing answer? Clicking “comment” means acceptance?

I got a audit question to review today that looked strangely familiar. Checking out the question (I'd read it recently) I saw that the purported answer (just as I remembered) was word-by-word ...
10
votes
2answers
266 views

Review audit test disagreements: theory and praxis

Following an audit test failure where I agreed that a question should be closed as too subjective, and was told that there were no major problems with it and I should have left it open, I have two ...
9
votes
1answer
222 views

Another failed review audit for low quality posts [duplicate]

I failed a review audit for an answer which is actually a comment. The user claimed to have insufficient reputation to leave a comment, but he/she wanted to stop other users from answering the ...
9
votes
1answer
716 views

Can this question be considered as off topic?

Question Link: A determinant expression Can someone please tell me how is this a "Good Question"? I was reviewing close votes while I came across this. This was an audit which I voted to close. But ...
9
votes
0answers
73 views

Review audit suggests “voting to close” an answer

Just passed a review audit. It suggested I "vote to close" an answer. Please fix this -- making the message dependent on the Q/A bit of a reviewed post should work.
8
votes
0answers
84 views

Duplicates as review audits

This happened to me: A question X was asked recently and was closed as a duplicate of a question Y. I faintly remembered these questions and when X came to me as a review audit question in the close ...
7
votes
1answer
150 views

Review queue tests in need of revision?

I was going through the review queue earlier when I was asked to review this question, which, in my opinion, is poorly written and most of its content is an image. Although, judging by this thread, ...
7
votes
0answers
78 views

Review audits should not include deleted migrated posts

I was just trying to procrastinate a bit of work, so I figured I'll check the review queue. This came up: https://math.stackexchange.com/review/close/571044 It is a closing vote review of a question ...
7
votes
0answers
158 views

Was the system correct in failing me for this review audit?

Please see: https://math.stackexchange.com/review/close/447772 I voted to close on the basis of "Off Topic", simply because no effort was shown toward a solution (which seems to be quite important on ...
6
votes
1answer
296 views

Review test - Imperative PSQ

So apparently imperative PSQs are acceptable, (even more than that, they are high quality posts). I'm pro-PSQ, that's why I let it open. Despite that, as far as I know, the community is anti-PSQ, so ...
6
votes
0answers
126 views

Review page warning - Is it logical? [duplicate]

I was reviewing a post and suddenly a 2nd post, the answer by Andre Nicholas came up. I made the following comment: "If any polynomial of $n$ degree has more than $n$ zeroes, then it is called an ...
5
votes
1answer
173 views

The simplest review audit…

I just passed a review audit. See here. As you can hopefully see from the link, I was one of those who voted to close the original question about two weeks ago. This smells like a bug to me...
5
votes
1answer
142 views

Rating users edit reviews

Today, for the $\text{n}^{\text{th}}$ time, I gave an edit some careful consideration and accepted it only to discover that it had already been rejected. I would quite like to point out to the two ...
5
votes
0answers
105 views

Strange comments in review audit

I recently encountered a review audit in the "Suggested Edits" queue, with the following comment, presumably fake, from the purported editor of this question: This is a homework question from a ...
5
votes
0answers
118 views

Review audit failure for editing a low quality question?

I just failed a review audit by attempting to edit the question, which turned out to be low quality. Strangely enough, the system message says that I failed because I was upvoting it (which I did not)...
5
votes
0answers
214 views

Are user names in the audits completely random?

Recently I passed some reputation threshold and started receiving tasks of reviewing suggested edits/first posts/late answers. Among the first kind of tasks, there are some (as I guess) fake ...
5
votes
0answers
132 views

Failed review audit for adding comment [duplicate]

I was just doing some first post reviews, and there was a post that simply asked a question with no attempt shown, so I was going to add a comment asking what the OP had tried, and apparently I failed ...
5
votes
0answers
122 views

Making review audits more realistic

Take only real examples from real review queues. Don't tell me there aren't enough real rejected edit suggestions and the system has to make up absurdly unbelievable ones. Present the audit exactly as ...
4
votes
1answer
171 views

Why display “this was only a test” after passing a review audit?

I was reviewing some closing votes, and I stumbled into a question which seemed ok to me: at most, I would have added a soft-question tag. So I clicked on "leave it open"; a message appeared, saying ...
4
votes
0answers
100 views

A flag that should have been, but shouldn't be, but was…

While processing a review queue, I was presented a question which "had been flagged as spam". I recalled seeing a very similar question a short while ago, and wondered if it was related. Lo and ...
4
votes
0answers
93 views

review task: test failed [duplicate]

I today did a review task. I noticed the answer by a new user was a copy paste of an earlier exactly same answer that I read on the site by a trusted user. So I flagged the answer as needing moderator ...
4
votes
0answers
53 views

When does the website decide to give you audits while reviewing?

When I was reviewing "First Posts" just now, there were two posts to be reviewed. I clicked "No Action Needed" for the first one, then a review audit came up (which I passed). Other times, when I ...
3
votes
0answers
68 views

A possible bug in reviewing close vote

I was reviewing some close vote recently and come to this one: https://math.stackexchange.com/review/close/348342 The particular question is not important. The main point is that I wanted to leave a ...
3
votes
0answers
64 views

Level of confidence in review queues [duplicate]

In review queues sometimes Review audits appear to check if one pays attention. Is it a permanent feature or there exist some level of reviewer's authority (as for example Trusted User may suggest) ...
2
votes
1answer
121 views

Who chooses test questions in the review queue?

Some questions in the review queue are there only to test the reviewer. Who chooses those?
2
votes
2answers
44 views

Review Audits - Posts with links

There have been a few review audits that have been failed recently because the post, on the surface, seems relatively okay. Following the links, though, shows that the post is copied verbatim without ...
2
votes
0answers
149 views

Answers to obvious duplicates

What to do with answers to questions which are obvious and exact duplicates of existing questions? I'm talking about this review I recently did. The answer was to one of those limit/inequality/...