Sorry for misusing term reputation
I've observed that some flags (I don't remember which!)(If not all) Cast an implicit down-vote on post (again, I'm not sure about questions or answers). Will that down-vote which I didn't cast show up in my down-vote count? (And this was the reputation I was talking about)