That’s the most unreasonable question you could ask someone.
Here is why:
If they don’t smoke and are not comfortable with being a passive smoker, now they are the culprit, not the person who is smoking.
It almost puts the person being asked the question as if they aren’t violating someone’s privacy.
A good thing to rather do is (even though I have never smoked and am against the concept of damaging your lungs):
Would you want to join me for a smoke?
If they are okay, they will join.
If they are not okay (like me), they will quietly distance themselves.
It gives you the clear answer of other person’s consent, which I think is an important thing in matters that have varied extreme sharp opinions.
Bonus advice: You never regret not smoking 🙂