Popularity of the patron.

I think a cleric can choose a domain without choosing a god. They can also stop following their god without grievous consequences. Warlock patrons aren’t kind to pact breakers.