# Examples of poor review audits

Since threads about review audits seem to be turning up fairly frequently now, it seemed like a good idea to open a thread to collect examples of those audits where people failed but feel like they should not have.

This serves both the purpose of getting at least a small idea of the scale of this (ie, how often does it happen), and also means that we will potentially get information enough to suggest concrete changes to the algorithms used for picking the audit cases (if this seems necessary).

• board of shame is a better name for this question – Norbert Sep 11 '13 at 14:52
• And for venting! It's frustrating to spend time thinking about a post, only to be told that I've chosen the wrong answer. – Douglas S. Stones Sep 11 '13 at 16:50
• @DouglasS.Stones that too, without each person needing to vent having to open a new thread for it (assuming they actually see this one). – Tobias Kildetoft Sep 11 '13 at 17:52
• I seem to recall that it is possible to remove audits from the audit system -- this post could be useful for that. But I can't find the source. Is there anyone who can verify this? – Lord_Farin Sep 12 '13 at 14:05
• I get quite a few, but they are glaringly obvious and quick to dismiss. – copper.hat Oct 27 '13 at 20:38
• math.stackexchange.com/questions/535020/… is too broad for sure and to some extent lacks context. – dfeuer Nov 3 '13 at 2:53
• It appears that the audits have now been redesigned - clicking close on an audit wasn't an automatic pass for me just now, but rather gave me a chance to click an option first. – user61527 May 22 '14 at 5:46
• While the thread is obviously useful as a way to vent frustration, seeing it bumped repeatedly gets old. I think it would be better implemented as a chat room, similar to Whining Room on Meta. Or just add the (whining) tag. – user147263 Jul 30 '14 at 17:46
• @900sit-upsaday I agree. It was originally supposed to provide examples that could show how it might be improved, but it seems clear that this will not happen. And if you think it is annoying to see it bumped, consider getting a notification each time making you think "ahh, someone is speaking to me" only to see that it is just another answer to this question. – Tobias Kildetoft Jul 30 '14 at 17:58
• @TobiasKildetoft You can ask SE to be disassociated from this thing; I'm sure that seeing the situation they'll honor the request at once. – user147263 Jul 30 '14 at 18:00
• Should we add the tag (big-list) to this question ? – GNUSupporter 8964民主女神 地下教會 Dec 12 '17 at 17:17

I got this one:

https://math.stackexchange.com/review/close/1194064

I passed it by leaving it open, but it seems not nearly clear-cut enough to qualify as a good review audit. The asker has not provided much in the way of evidence of effort.

I also floated this in a discrete Meta question, before posting here.

I passed this one (the alleged closure reason was "too broad", which it's not, and the score was artificially $0$), but Monoids with left common multiples actually does lack context. What is the source of the OP's intuition (is there a special case where this holds)? What did they try?

• I think 'So this is a result which I think is true but have yet to find a quick proof for.' constitutes enough context. It may not be question of the year, but it's far from a PSQ. – Dan Rust Sep 17 '13 at 10:06
• @DanielRust, I don't see how stamping words like that onto the end of a PSQ make it anything more than a PSQ. – dfeuer Sep 17 '13 at 19:35
• I've had a few now with alleged closure reasons which don't fit but which should be closed for lacking context. Most recently this one. – Peter Taylor Sep 24 '13 at 18:57
• @Peter: Fortunately, André got there first. – Brian M. Scott Dec 1 '13 at 5:00

https://math.stackexchange.com/review/close/929400

The system claimed it's marked with unclear what you're asking, but I voted to close this question for off topic due to the question writer's lack of response to another user's question "What did you try? ..."

https://math.stackexchange.com/review/first-posts/1068861

The question is about the boundedness of manifolds embedded in Euclidean space, with closed curves being the motivating example. The answer reads

How is your definition of closed curve? If it just a continuous image of $S^1$ then it is compact, so bounded in $\mathbb{R}^n$

This would be appropriate for a comment (specifically, it appears that the answer is asking for clarification about what is meant by a "closed curve", then addresses only that part of the question).

• However it does assume a choice of definition and answer, in admittedly terse fashion favored by some, the part of the Question raised in the title. Of course it is far from a true first post, which is irksome. – hardmath Sep 30 '18 at 7:02
• @hardmath I am not trying to argue that the answer is terrible as an answer (it is pretty borderline if you ask me, and my reaction in the review queue was that it should have been a comment, not an answer, hence I flagged it as such, but I agree that it is a close call). My complaint is that it is terrible as a review audit. Review audits are supposed to be unambiguous, and are meant to ensure that people are actually reading what they review and not just click-click-clicking. – Xander Henderson Sep 30 '18 at 11:55

Another gem. The question was whether to close it as unclear, and the answer was clearly no — the OP is explicitly asking how to construct such a completion. This was so obvious that I foolishly didn’t bother to check the original. It turns out that the line How might I go about this? was added by someone else, and the original question was genuinely unclear.

I got this one: Maximal value of dimension. I voted to close because of "his question is missing context or other details".

Latest dubious audit question: https://math.stackexchange.com/review/close/202870

Yesterday I failed this audit in the following way : The answer was presented as a First Post. I spent some time to understand the chain of ideas and conclude that it is a mathematically correct answer. Although I estimated (and still do) that it deserves more explanations. I don't believe it would be accepted either as an answer in a school test not in a peer-review article. As it was presented as a First Post, it is logical to react and ask for improvement. Therefore I wrote a comment and got the "STOP ! Look and listen" message before I could select to keep the answer.

• While I disagree with your assessment of the answer, it is definitely problematic that merely writing a comment is considered an incorrect action. – Eric Wofsey Nov 6 '15 at 17:36
• @EricWofsey. The other comments were not available during the audit. Some of them tend to agree that the answer could have been more detailed. – Tom-Tom Nov 7 '15 at 21:13

https://math.stackexchange.com/review/close/959283

I failed this Review Audit for the Close queue, but curiously it seems a different user is shown passing it! However I'm using it to call attention to the mechanism of changing the imputed Close Reason.

The Question had been closed as unclear what you are asking but shows in review as (potentially) too broad. While one might agree that asking something which is essentially an immediate application of the defintion (Why is the sequence of Fibonacci numbers countable?) leaves Readers wondering what the problem is really asking, it is clearly something that can be answered (and was) in brief but detailed fashion.

I just wanted to point out the strange alteration of the actual close reason. It seems to me many "false negative" reviews use primarily opinion based as the proposed close reason, which I suspect is one of the least actually used reasons, and "too broad" strikes me as a less rare but still infrequent case.

https://math.stackexchange.com/review/close/1140429

This question, while it is nicely typeset and all, asks two questions at once. Therefore it should be closed as "too broad". ("Avoid asking multiple questions at once.")

I've commented on an answer to a question about division by zero from a person in the 9th grade saying that the answer may be hard to understand by the OP and I failed because I should have not commented.

I suggest that this specific answer is removed from the test list.

https://math.stackexchange.com/review/close/1201934

I voted to close the question as being "Too Broad." In general, I think that questions beginning "What kinds of mathematics can be done with [insert topic here]?" are not really good for this site (I'm curious---is there a consensus on this?). Even if the community ultimately feels that this question is appropriate, I don't think that it is a good audit question.

Question link: Proving $x^2+x+1\gt0$

Screen capture:

When I got to this question, I actually opened up the post to see the score and the close votes of the post (I almost always do that when reviewing, unless the post is really bad and obviously deserve to be closed).

However, although this question is well-received, I think that this question is pretty much opinion-based, as it asks for as many ways to prove $x^2+x+1>0$ as possible.

I decided to vote to close as "primarily opinion-based" and of course I failed the audit, luckily I hadn't failed any other audits in the last 30 days.

At this point, I'm not really sure if there is a "close vote guidelines" about this type of questions that ask "as many ways as you can think of", or maybe I'm a bit too strict.

• I don't see how a request for a list of different ways of proving a given result can be interpreted as "primarily opinion-based". – Gerry Myerson Jul 20 '18 at 0:30
• I probably think so too, after seeing the highest-rated question here: "Visually stunning math concepts which are easy to explain". – Trần Thúc Minh Trí Jul 20 '18 at 1:28

https://math.stackexchange.com/review/close/231217

This is a badly-written question, no doubt about it, and it deserves its downvotes. But I disagree that this question should be closed (except perhaps as a duplicate), and strongly disagree that the close is so clear-cut that it should be included as a review audit. After all, an identical question got 20 upvotes on Mathoverflow...

• Link to MO question? – Did Jun 24 '14 at 17:28
• – user7530 Jun 24 '14 at 19:46
• The questions are hardly identical: the MO version provides two specific suggestions, the MSE none. – Did Jun 24 '14 at 20:13
• @Did So asking, "I've heard 2 and 5 are prime numbers. What are more examples of prime numbers?" is hardly identical to "What are some examples of prime numbers"? The former shows more conscientiousness and effort, perhaps, but beyond that I'm afraid I don't agree. – user7530 Jun 24 '14 at 20:33
• I think the question on MSE is bad because it's not at all clear why the asker believes that there is a connection between pi and primes (I think there is, but need help with proof), nor even at all what they mean by "direct link." In the MO question, it was fairly clear what was being asked, IMHO. – user61527 Jun 25 '14 at 2:06