The only real hazard is the baby swallowing - or choking on - a piece of a broken balloon. I'm sure that most mothers - and all good ones - would watch closely to make sure the baby didn't put those in his or her mouth.
The long skinny balloons are great for hitting things with too.