Sure. Ideally, which is what the comments and the other answers deal with, votes would reflect the content of the answer, and the quality of it.
Alas, this is not really the case, is it now? Can anyone argue that the famous $\mathsf{W}$ is any better than an answer which actually give a long and details explanation of something nontrivial? No. We can't argue that. The $\mathsf{W}$ is simply popular. And people need to understand that voting, while often and perhaps in most cases, reflect to some extent the mathematical validity of the content, also reflect how much the community simply likes the answer, or the user.
But let us talk for a moment on what's really going on in this meta thread. The OP opened this post after a comment I had left to him (which for some reason he took an extra effort to copy-paste into the reply box). This user has a very rich history of not caring what anyone else thinks. This user has a very long history of telling people to open meta threads, and to completely ignore anything that happens.
In a recent thread Brian M. Scott wrote in a comment "once burnt, twice shy". So what can we do?
Believe you me, when the problem just began with this user I was polite, and he ignored. Others were polite, and he ignored. I discussed this with the moderators, and they debated more while he continued to act. When meta threads were opened about him, he ignored. When he was actually suspended for his behavior one recently-former moderator quickly undid the suspension claiming it was unilateral and unjust. The suspension was re-applied, and the same thing happened again.
So what are we left with? We are left with a user that had a lord and protector from suspensions, continued to ignore all criticism, and continued to do whatever he pleases, despite continuing requests.
Sure, in the general case, in the ideal case, one shouldn't vote based on the user and their actions. But this is not the ideal case, and whatever this thread ends up reflecting will be used by that very borderline antisocial user to insist that things which transpired in the summer of 2012 are now unfair and must be reversed.
I don't know about any of you people, but I wouldn't let someone with a rap sheet full of arrests for theft the keys to my apartment. When a user continues on and on and there is no other way to make them understand that what they are doing is wrong then the community, like a sick body, has to react and try to defend itself somehow. To the common user [read: non-diamond moderators] the only remaining way is to downvote, close and delete.
So sure, generally one shouldn't downvote based on the user. But we tried this before, discussing the general case in the OP's case, and it led nowhere. We even tried to discussing the specific case and it haven't really led anywhere either. The OP will continue to behave and do whatever he wants, and none of us can do anything to change that.
Historical reminders: (Please don't bump these threads, it would serve no good now, but they can shed light on the origin of this meta post now)
- How much (self) editing is too much?
- Where is the fine line between using and misusing? (in particular this comment which is relevant here.)
- Use of main-site comments for meta suggestions