You should drink tap water it’s pure and wonderful; Icelanders will look at you askance if you ask for bottled water.