First and foremost:
You are not alone feeling/thinking that on some occasions you would prefer only to cast an ordinary vote!
I don't think you can forsake the superpowers, but you can use them responsibly. I don't think there are any normative guidelines for this. Instead I list a few thoughts I recall having, and practices I have tried to implement.
A full list of badges with clarifications can be found here: What are the badges I can earn on each site, and what are the exact criteria for earning each badge?, but let me answer your specific questions:
Shouldn't this description be "First bounty you manually award on another person's question's answer"?
That's Altruist, and the description is ...
Theoretically possible but not encouraged:
Can I get my gold badge revoked?
If you worry about closing posts mistakenly as duplicate, you can go to the CURED chat room1:
For feedback/discussion/requests of Close/Undelete/Reopened/Edit/Delete for questions and answers on Math SE
Just as asking an unsatisfactory question is not committing a crime on the ...