IMO … That’s not usually how it works. Much more effective to create some scandal. Maybe he used to be friends with someone who is now a pedophile. Maybe he once didn’t pay a builder, or shouted at a stranger’s child. There’s always something that can be spun into a career-destroying story. It just needs to be discovered with just the right timing.