or the person who left the rep has disabled their rep and thus it doesn't count.
My rep has been disabled for months. Ive repped and derepped people in that time. Ive added and subtracted bars too, with my rep disabled. So, that cant be it. The only other reason not mentioned in this thread for a neutral rep is if someone with negative reputation tried to leave rep, it doesnt count.