I had a question for which I put $500$ points in a bounty. The bounty wasn't taken by anyone. I deleted the question just now and it seems that I got the points back. At least my rep. went up pretty much by the amount of that bounty for no reason.

Was that what happened? Is that supposed to happen?