29
$\begingroup$

I have two questions.

First, how "effective" is asking a question on the math stack exchange? I find 3252 pages of questions in the "unanswered" section - these questions have received zero responses. This is almost 20 percent of the 17465 total pages asked, meaning 1 in 5 queries never get a single answer.

Second, is it known what percent of questions on the exchange are asked by "established" users, and what percent are asked by random anonymous users (like me!) who basically sign on for one day to get unstuck on a homework problem and then never come back?

I don't ask these questions because I'm critical of the site, but I wonder if there would be some way to make it more effective (assuming its goal is to be conducive of the best discussion in mathematics).

$\endgroup$

migrated from math.stackexchange.com Apr 7 '14 at 2:40

This question came from our site for people studying math at any level and professionals in related fields.

  • 17
    $\begingroup$ One correction. Many questions in the "unanswered" bin do indeed have answers, but the questioner has failed to accept an answer. I very frequently have to remind the questioners please to do so once they're satisfied. $\endgroup$ – Ted Shifrin Apr 7 '14 at 1:30
  • 1
    $\begingroup$ @TedShifrin Thank you, I did not notice that. It is true that a sizable proportion have some answers. From skimming a few of the pages, I get the sense that only a small amount (maybe 10%?) of those forgot to accept an answer - as in, the "answers" provided were not really answers, but general "advice", links to other pages, partial solutions, etc. But maybe I should revise my statistics... $\endgroup$ – user140943 Apr 7 '14 at 1:32
  • 10
    $\begingroup$ @TedShifrin I was under the impression that questions don't appear in the unanswered bin unless they have no upvoted answers, i.e. the answers that do exist aren't good enough. $\endgroup$ – Mario Carneiro Apr 7 '14 at 1:33
  • 3
    $\begingroup$ @MarioCarneiro: Yes, you're right, but my comment stands. Plenty of users don't know the protocol to upvote or accept. I've had some questioners accept with no upvote. I've had some who were satisfied and did neither. $\endgroup$ – Ted Shifrin Apr 7 '14 at 1:38
  • 2
    $\begingroup$ The irony of this is that it's not getting an answer... $\endgroup$ – user140943 Apr 7 '14 at 2:17
  • 9
    $\begingroup$ @MarioCarneiro I second Ted's objection to the inference "i.e., ... aren't good enough". There are thousands of answers that resolve the question completely, but remain with zero score. Voting system isn't a perfect judge of answer quality. $\endgroup$ – user127096 Apr 7 '14 at 3:14
  • 2
    $\begingroup$ @TedShifrin But unlike the protocol for accepting a question, anyone at all (including you) can upvote a question, so if you see an "unanswered" question that in fact has a good answer that has merely not been upvoted, you can just upvote it yourself and get it off the queue; there is no reason why the non-participation of other users should stop these questions from getting off the queue. $\endgroup$ – Mario Carneiro Apr 7 '14 at 3:15
  • 3
    $\begingroup$ @MarioCarneiro Yes, and there was (is?) a somewhat concerted effort to get those question out of the Unanswered list: Crusade of Answers. It's not as easy as it sounds... the site is huge, and the number of people involved in the Crusade is tiny. Also, it's very hard or impossible to judge quality of a technical answer in a field out of one's area of expertise. So, answers in more narrow areas, where few experts are present, are mostly out of luck. $\endgroup$ – user127096 Apr 7 '14 at 3:25
  • 3
    $\begingroup$ @cheap Actually, in my opinion the worst offenders for incorrectly categorized "unanswered" questions are those questions where the problem is completely resolved in the comments. In this case your only recourse is to post your own answer (and be accused of stealing the "glory") or prompt the comment answerer to post a real answer. $\endgroup$ – Mario Carneiro Apr 7 '14 at 3:25
  • 3
    $\begingroup$ @MarioCarneiro I haven't seen a single accusation of stealing in such cases, directed either at me or at others. I did post a few such answers; I even shared my workflow for this. $\endgroup$ – user127096 Apr 7 '14 at 3:27
  • $\begingroup$ @cheap Also, I don't see any problem with simply dealing with these cases as they arise in the natural course of things, rather than a concerted effort to clean it up, unless you are thinking like the OP and want to take aggregate statistics on the total number of unanswered questions. $\endgroup$ – Mario Carneiro Apr 7 '14 at 3:29
  • 1
    $\begingroup$ @cheap I guess I didn't mean the "stealing" literally; but I gather that this behaviour is generally discouraged in preference to the person who actually answered the question posting an answer, so that they can receive their justly earned rep. $\endgroup$ – Mario Carneiro Apr 7 '14 at 3:31
  • $\begingroup$ @cheap I'm not very active on meta, so I don't know where to refer you to; but it seems consistent with the general philosophy of the rep system. Do you not agree that it would be better if the person who answered the question posted that answer so that they could be rewarded for their hard work? $\endgroup$ – Mario Carneiro Apr 7 '14 at 3:44
  • 2
    $\begingroup$ @MarioCarneiro Your second sentence makes it sound as if someone prevents those users from posting an answer. If they chose to post a comment but not an answer, it's their choice and I respect that. My choice is to post an answer, possibly using their content (with attribution), which is exactly in the SE spirit. I haven't seen any sign of discouragement when I did that. $\endgroup$ – user127096 Apr 7 '14 at 3:47
  • 2
    $\begingroup$ @MarioCarneiro Questions answered in comments have been discussed on meta several times, posting a CW-answer summarizing the comments is the recommended approach, if the commenter does not post the answer: meta.math.stackexchange.com/questions/1148/… $\endgroup$ – Martin Sleziak Apr 7 '14 at 5:23
24
$\begingroup$

The efficacy is not accurately measured by the size of the Unanswered category. Yes, there are about 48K questions there, but only 34K actually have no answers. The rest have at least one answer, which in many cases fully deserves an upvote, but does not have one yet. And among the questions with no answers at all many received helpful comments; unfortunately there is no way to obtain a count of those where the comments helped.

Let's count the questions that truly sank without a sound: no answers and no comments. Exclude those that were somehow rejected (closed or downvoted). We are left with ... 9461 questions, out of the total of 262K questions currently on the site. Not that bad.

To your second question: I took the reputation of the askers of the most recent 10000 questions; focusing on recent questions allows to reduce the effect of postfactum reputation changes, and also gives a better idea of the current state of events. Out of $10000$ questions:

  • $82$ were asked by users with reputation $10000$ or more
  • $183$ were asked by users with reputation $5000$ or more
  • $955$ were asked by users with reputation $1000$ or more (called "established users" by SE)

The median was $61.5$.

So, less than $10\%$ of askers were "established" by the SE standard. The reputation of the rest is presented in the histogram below:

reputations

Then I did the same for $10000$ most recent answers. Out of these:

  • $700$ were posted by users with reputation $100000$ or more
  • $2995$ were posted by users with reputation $10000$ or more
  • $7140$ were posted by users with reputation $1000$ or more (called "established users" by SE)

The median was $3734$. (The author of a randomly chosen answer is more likely than not to be able to vote to close.) Established users, who ask less than $10\%$ of questions, answer more than $70\%$ of them.

This time, the histogram is based on users with rep under 100K:

enter image description here

$\endgroup$
  • 5
    $\begingroup$ The main statistic I get out of this is that 24.5K - just over half - of all unanswered questions are in the "commented, no answers" category, a rather worrysome statistic for the issue of answers in the comments. $\endgroup$ – Mario Carneiro Apr 7 '14 at 4:08
  • $\begingroup$ It might be useful to break this group down by question vote total - most of the highly upvoted questions with no answers are simply good open problems. $\endgroup$ – Mario Carneiro Apr 7 '14 at 4:11
  • $\begingroup$ @MarioCarneiro There are comparatively few of those however. $\endgroup$ – Alex Becker Apr 7 '14 at 6:28
  • $\begingroup$ Also towards the second question, there are 57755 questions by users with more than 1000 rep, and 7038 by users with more than 10000 rep. $\endgroup$ – Alex Becker Apr 7 '14 at 6:29
  • $\begingroup$ Some statistics on the number of questions asked by high-rep users are given here. They are from May 2013. I thought it was worth mentioning if someone wants to compare how these numbers have changed. $\endgroup$ – Martin Sleziak Apr 7 '14 at 7:16
  • $\begingroup$ While browsing through your remaining 9461 questions, I noticed that a) very fresh questions are doomed to be counted there; and b) Questions like this are counted, which is merged with a question having an upvoted and accepted answer $\endgroup$ – Hagen von Eitzen Apr 8 '14 at 17:07
  • $\begingroup$ @HagenvonEitzen Yes, so the precision in "9461" is misleading; it should be "nine thousands or so". There is no easy way to filter out merged (locked) posts, as far as I can tell. $\endgroup$ – user127096 Apr 8 '14 at 23:37
14
$\begingroup$

One point, if an answer appears entirely in comments, or if it just would be helpful to other readers to have all of the good parts from a comment thread in one place, anyone can post that as an answer after waiting a bit, then click on Community Wiki as part of editing in the answer. CW is always a choice for answers. That way, the full answer is readable, while some respect is shown for the people who chose to answer in comments.

$\endgroup$
  • 4
    $\begingroup$ This is not an answer to the question so it should have been a comment. $\endgroup$ – Bill Dubuque Apr 12 '14 at 17:11
2
$\begingroup$

One of my questions has a number of good answers which I have not accepted. That's this question, which is a "Big List, Soft Question, Community Wiki" type - further contributions are welcome, but what would an accepted answer look like? I've up-voted all the answers I like, and there are 20 answers, all good - except that I haven't voted for my own answers.

Would an "accepted answer" add anything to this - and would taking it off the "unanswered list" reduce the likelihood of future contributions to the "big list"?

$\endgroup$
  • 5
    $\begingroup$ Re: Would an "accepted answer" add anything to this - and would taking it off the "unanswered list"... If a question has at least one upvoted answer, it is not considered unanswered (and it is not shown in the unanswered tab). $\endgroup$ – Martin Sleziak Apr 12 '14 at 15:49
  • $\begingroup$ @MartinSleziak Thanks for that clarification - helpful to know $\endgroup$ – Mark Bennet Apr 12 '14 at 16:23

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .