Am I really bathing if I’m using water I cannot drink?

Yes, drinking water is cleaned to the point that it will not make you sick to drink assuming a normal immune system. That is extreme over kill for bathing (and toilets, laundry, etc). The only reason we use drinking water for everything is because infrastructure is expensive and laying non-potable water pipes would cost tons.