Yeah, it’s to protect them from disease. In almost all circumstances a place with tap water from a municipal source is fine.

Premature infants might be advised to only get sterile water for a bit as an extra precaution, and people might also hold off a little longer on well water.