At the end of the day, nothing we do with this will please everyone. It's just not possible.
What we've done is for the best. You wouldn't believe the absolutely ridiculous and childish things we have to deal with concerning rep.
There's a very, VERY good reason that Facebook never implemented a "dislike" button. I can see that very clearly now that we've had the forum equivalent of such for the last couple of years.
It's really simple -- if you don't like something that someone says then you can show that by not adding to their reputation. If you do like it, show by adding reputation. If your reputation suddenly drops by 6+ bars, you know that someone with a grey or blue name did it and I assure you there'll be a reason.