I think pollution is better thought of like starvation, as something that makes you frailer so that you end up dying over something that a healthier person would have survived. Pretty much the opposite of the perspective you take.

You don't see a lot of people arguing that starvation doesn't mean much because the deaths of starving people are more directly caused by disease or injury.