That line of arguing is exactly why it doesn’t work. And in general I agree that banning things because someone else doesn’t like it is wrong, getting rid of smoking wherever possible is better for everyone, including the smokers.

For what it’s worth, pretty much everyone here in Austria agrees that the ban on smoking in indoor establishments was a good thing. It’s just so much better to come home from a night out and not reek like smoke so badly that everything you touch will smell for days.