The main reason is that there is much more water than there is Br-, so a reaction between the bromonium ion and water is more likely than Br- attacking the bromonium ring.
More than that, though: the Br- is solvated and surrounded by water molecules, which both distributes its charge density...