I have only commented so far with only positive reception, all my comments are in the positives and I only have 5 downvote all I am pretty sure coming from the same person on the same thread, yet I have -5 rep, why?

if I add my positive upvotes, likes, whatever and subtract my 5 downvotes I would have 97-5 which is 92, why do only downvotes or negative interaction count but not positive?