I don't think informed consent is violated by removing a pollutant. But adding a substance as a healthcare treatment denies informed consent as an individual right, and turns it into a majority right. I'd hate for that to happen to other civil rights.
Should we also stop adding iodide to salt or fortifying white bread? I see your point, but society has benefited as a whole by forcing some of these substances onto populations. I think it's fairly evident that many humans in the US are either unable or unwilling to really care about their health.
Bad analogy. Fortified food provide nutrients to supplement what you get from other foods. One can simply choose to buy white bread that's fortified, or whole foods that have those nutrients naturally.
You can't avoid water for too long though. Ingesting whatever is in the water supply is mandatory. I can't avoid flouride in my water any more than I can avoid Nitrogen when I breathe. I have no choice in the matter. It's the lack of choice that many object to, not the health effects of flouride per se.
Personally, if given the choice, I'd probably still take flouride. Having it in the water is convenient. Mandatory, but convenient.