Timeline for Site self-evaluation: what is it?
Current License: CC BY-SA 3.0
8 events
| when toggle format | what | by | license | comment | |
|---|---|---|---|---|---|
| Feb 5, 2013 at 10:55 | comment | added | Phira | On the beta sites, the ten questions were actually discussed which makes a lot more sense if people articulate why they do not deem a question excellent. | |
| Feb 4, 2013 at 6:51 | comment | added | Michael Greinecker | I think it is worth noting that, at least on mathematics, few people are competent to really judge the quality of all test questions. Specialization matters a lot here. | |
| Feb 3, 2013 at 21:41 | comment | added | Asaf Karagila Mod | @Shog: That is also very true. But you can always allow each user to review at most 10-15 questions, even if your sample size is roughly 60-70 questions. You simply define that after $n$ reviews a question is taken off the queue of everyone. | |
| Feb 3, 2013 at 21:38 | comment | added | Shog9 Mod | @Asaf: well, I suspect before picking a sample size it would be necessary to have a specific goal in mind for the results. 10 was chosen for beta sites since it's small enough that you can reasonably expect folks to actually review all of them in the set, and large enough to give a reasonable overview of the (usually fairly small) volume of traffic on such sites (in some particularly quiet betas there are actually less than 10 questions eligible!) But since obviously we're not checking Mathematics for graduation eligibility, we've no specific interest in the results of these reviews. | |
| Feb 3, 2013 at 21:35 | comment | added | Asaf Karagila Mod | @Shog: I see. This was my point about sample size, it's too small to possibly conclude anything meaningful. Perhaps set it to a percentage of the questions asked within the last 90 days (which should, by my estimates, be around 6-10k posts), maybe only questions which have votes or answers, which may cut down the amount by a third or so, then take like 1% which would be 40-60 questions instead. But what do I know about these things! :-) | |
| Feb 3, 2013 at 21:32 | comment | added | Shog9 Mod | It's a random sample of questions from the past 90 days, @Asaf. As it was intended for smaller sites (those still in beta), the sample size may easily be too small to be useful on graduated sites. | |
| Feb 3, 2013 at 21:25 | comment | added | Asaf Karagila Mod | But how were these ten posts chosen? Are they arbitrary? Isn't that like testing one cup of water from the ocean and deducing that there are no fish and hardly any pollution in the entire ocean; or that the entire ocean is full of amoebas and pollution? (Depending where you got that cup of water from...) | |
| Feb 3, 2013 at 21:01 | history | answered | user9733 | CC BY-SA 3.0 |