That’s why it’s so important to specify that men are victims of patriarchy, not victims of men. Everyone, regardless of gender, has an environmental tendency to reinforce the societal structure that we label “Patriarchy”, as you say (and I/many agree), but there’s far more to it than the idea of “men first women second”. The idea behind the phrase is not “everyone vs. men” but rather “everyone vs. harmful but deeply engrained social construct”.
Therapy and/or an ADHD diagnosis (not joking, one symptom of neuroatypical people is the inability to identify emotions in themselves (like me lol)).