The first time one of my answers was "unaccepted" I was surprised, not hurt. I mean, I guess at that time I was so eager to make one the earlier (in terms or reputation points) benchmarks that I felt a twinge of disappointment; but once I learned that whereas votes can't be changed, acceptance can (and guess how I learned that--by having the answer unaccepted!), I just "accepted" the situation.
It seems to me the easiest "solution" here is to educate users so their expectations are based on reality.
Another thing is just to wait awhile before accepting to let the answers roll on in!
But if you feel an answer is what you want and need, well, the decision is yours . . .
As to whether I care about having an answer unaccepted or not: well, I cared a lot more when my rep was under $1,000$ than I do now . . .