Roslyn officials are warning residents of potential contamination of their tap water after a break in the city’s water main late Thursday night.