# Examples of poor review audits

Since threads about review audits seem to be turning up fairly frequently now, it seemed like a good idea to open a thread to collect examples of those audits where people failed but feel like they should not have.

This serves both the purpose of getting at least a small idea of the scale of this (ie, how often does it happen), and also means that we will potentially get information enough to suggest concrete changes to the algorithms used for picking the audit cases (if this seems necessary).

• board of shame is a better name for this question – Norbert Sep 11 '13 at 14:52
• And for venting! It's frustrating to spend time thinking about a post, only to be told that I've chosen the wrong answer. – Douglas S. Stones Sep 11 '13 at 16:50
• @DouglasS.Stones that too, without each person needing to vent having to open a new thread for it (assuming they actually see this one). – Tobias Kildetoft Sep 11 '13 at 17:52
• I seem to recall that it is possible to remove audits from the audit system -- this post could be useful for that. But I can't find the source. Is there anyone who can verify this? – Lord_Farin Sep 12 '13 at 14:05
• I get quite a few, but they are glaringly obvious and quick to dismiss. – copper.hat Oct 27 '13 at 20:38
• math.stackexchange.com/questions/535020/… is too broad for sure and to some extent lacks context. – dfeuer Nov 3 '13 at 2:53
• It appears that the audits have now been redesigned - clicking close on an audit wasn't an automatic pass for me just now, but rather gave me a chance to click an option first. – user61527 May 22 '14 at 5:46
• While the thread is obviously useful as a way to vent frustration, seeing it bumped repeatedly gets old. I think it would be better implemented as a chat room, similar to Whining Room on Meta. Or just add the (whining) tag. – user147263 Jul 30 '14 at 17:46
• @900sit-upsaday I agree. It was originally supposed to provide examples that could show how it might be improved, but it seems clear that this will not happen. And if you think it is annoying to see it bumped, consider getting a notification each time making you think "ahh, someone is speaking to me" only to see that it is just another answer to this question. – Tobias Kildetoft Jul 30 '14 at 17:58
• @TobiasKildetoft You can ask SE to be disassociated from this thing; I'm sure that seeing the situation they'll honor the request at once. – user147263 Jul 30 '14 at 18:00
• Should we add the tag (big-list) to this question ? – GNUSupporter 8964民主女神 地下教會 Dec 12 '17 at 17:17

https://math.stackexchange.com/review/first-posts/929848

It came up as a first post and I intended to close it, either as unclear what you're asking, or as off-topic.

The problem itself is terribly worded, as most answers discuss. The question also shows no thoughts or effort whatsoever.

Turns out it has 24 upvotes.

• The question looks fine to me. "The problem itself is terribly worded" is the reason why the question was asked in the first place, so I don't understand this complaint. "The question also shows no thoughts or effort whatsoever." Effort and thoughts are not a requirement for questions here. We sometimes ask this for problems that look like homework, but from the first sentence of the question, it is clear that this is not the case. – Trevor Gunn Dec 28 '17 at 1:02
• @TrevorGunn Ok, perhaps the wording is not the issue here. But I disagree about lack of context. I thought that every question lacking at least minimal effort should be closed as off-topic and I have been reviewing accordingly. People downvote and request OP's thoughts on every such question. Could you please link to a source for your claim: "Effort and thoughts are not a requirement for questions here." I'm aware that it is sometimes a grey area, of course. If I'm wrong, I'm happy to be convinced otherwise. – mechanodroid Dec 28 '17 at 1:10
• See the discussion here. You'll also note that a lot of discussion re: effort is about homework exercises (which this question is not). You should also notice how many well received questions there are with no effort to solve them by the asker (here's one of David Speyer's). For the question in the review, I'm at a loss for what sort of effort could even be provided to a question of "this doesn't make sense, what does it mean?" – Trevor Gunn Dec 28 '17 at 1:34
• If you're still not convinced, consider opening a new question on meta so the discussion gets more attention. I would also be interested in seeing what other people think. – Trevor Gunn Dec 28 '17 at 1:34
• @TrevorGunn Ok, thank you. I'm actually a bit relieved because I found the "show your effort" policy a bit too strict myself, but I thought that is the way things are done here. – mechanodroid Dec 28 '17 at 19:57

https://math.stackexchange.com/review/first-posts/1068861

The question is about the boundedness of manifolds embedded in Euclidean space, with closed curves being the motivating example. The answer reads

How is your definition of closed curve? If it just a continuous image of $S^1$ then it is compact, so bounded in $\mathbb{R}^n$

This would be appropriate for a comment (specifically, it appears that the answer is asking for clarification about what is meant by a "closed curve", then addresses only that part of the question).

• However it does assume a choice of definition and answer, in admittedly terse fashion favored by some, the part of the Question raised in the title. Of course it is far from a true first post, which is irksome. – hardmath Sep 30 '18 at 7:02
• @hardmath I am not trying to argue that the answer is terrible as an answer (it is pretty borderline if you ask me, and my reaction in the review queue was that it should have been a comment, not an answer, hence I flagged it as such, but I agree that it is a close call). My complaint is that it is terrible as a review audit. Review audits are supposed to be unambiguous, and are meant to ensure that people are actually reading what they review and not just click-click-clicking. – Xander Henderson Sep 30 '18 at 11:55

I passed this one (the alleged closure reason was "too broad", which it's not, and the score was artificially $0$), but Monoids with left common multiples actually does lack context. What is the source of the OP's intuition (is there a special case where this holds)? What did they try?

• I think 'So this is a result which I think is true but have yet to find a quick proof for.' constitutes enough context. It may not be question of the year, but it's far from a PSQ. – Dan Rust Sep 17 '13 at 10:06
• @DanielRust, I don't see how stamping words like that onto the end of a PSQ make it anything more than a PSQ. – dfeuer Sep 17 '13 at 19:35
• I've had a few now with alleged closure reasons which don't fit but which should be closed for lacking context. Most recently this one. – Peter Taylor Sep 24 '13 at 18:57
• @Peter: Fortunately, André got there first. – Brian M. Scott Dec 1 '13 at 5:00

https://math.stackexchange.com/review/close/929400

The system claimed it's marked with unclear what you're asking, but I voted to close this question for off topic due to the question writer's lack of response to another user's question "What did you try? ..."

https://math.stackexchange.com/review/close/959283

I failed this Review Audit for the Close queue, but curiously it seems a different user is shown passing it! However I'm using it to call attention to the mechanism of changing the imputed Close Reason.

The Question had been closed as unclear what you are asking but shows in review as (potentially) too broad. While one might agree that asking something which is essentially an immediate application of the defintion (Why is the sequence of Fibonacci numbers countable?) leaves Readers wondering what the problem is really asking, it is clearly something that can be answered (and was) in brief but detailed fashion.

I just wanted to point out the strange alteration of the actual close reason. It seems to me many "false negative" reviews use primarily opinion based as the proposed close reason, which I suspect is one of the least actually used reasons, and "too broad" strikes me as a less rare but still infrequent case.

https://math.stackexchange.com/review/close/1140429

This question, while it is nicely typeset and all, asks two questions at once. Therefore it should be closed as "too broad". ("Avoid asking multiple questions at once.")

I've commented on an answer to a question about division by zero from a person in the 9th grade saying that the answer may be hard to understand by the OP and I failed because I should have not commented.

I suggest that this specific answer is removed from the test list.

Another gem. The question was whether to close it as unclear, and the answer was clearly no — the OP is explicitly asking how to construct such a completion. This was so obvious that I foolishly didn’t bother to check the original. It turns out that the line How might I go about this? was added by someone else, and the original question was genuinely unclear.

I got this one: Maximal value of dimension. I voted to close because of "his question is missing context or other details".

Latest dubious audit question: https://math.stackexchange.com/review/close/202870

Yesterday I failed this audit in the following way : The answer was presented as a First Post. I spent some time to understand the chain of ideas and conclude that it is a mathematically correct answer. Although I estimated (and still do) that it deserves more explanations. I don't believe it would be accepted either as an answer in a school test not in a peer-review article. As it was presented as a First Post, it is logical to react and ask for improvement. Therefore I wrote a comment and got the "STOP ! Look and listen" message before I could select to keep the answer.

• While I disagree with your assessment of the answer, it is definitely problematic that merely writing a comment is considered an incorrect action. – Eric Wofsey Nov 6 '15 at 17:36
• @EricWofsey. The other comments were not available during the audit. Some of them tend to agree that the answer could have been more detailed. – Tom-Tom Nov 7 '15 at 21:13

Question link: Proving $x^2+x+1\gt0$

Screen capture:

When I got to this question, I actually opened up the post to see the score and the close votes of the post (I almost always do that when reviewing, unless the post is really bad and obviously deserve to be closed).

However, although this question is well-received, I think that this question is pretty much opinion-based, as it asks for as many ways to prove $x^2+x+1>0$ as possible.

I decided to vote to close as "primarily opinion-based" and of course I failed the audit, luckily I hadn't failed any other audits in the last 30 days.

At this point, I'm not really sure if there is a "close vote guidelines" about this type of questions that ask "as many ways as you can think of", or maybe I'm a bit too strict.

• I don't see how a request for a list of different ways of proving a given result can be interpreted as "primarily opinion-based". – Gerry Myerson Jul 20 '18 at 0:30
• I probably think so too, after seeing the highest-rated question here: "Visually stunning math concepts which are easy to explain". – user061703 Jul 20 '18 at 1:28

https://math.stackexchange.com/review/close/1201934

I voted to close the question as being "Too Broad." In general, I think that questions beginning "What kinds of mathematics can be done with [insert topic here]?" are not really good for this site (I'm curious---is there a consensus on this?). Even if the community ultimately feels that this question is appropriate, I don't think that it is a good audit question.