After the above I looked out again and there was a second baby and counting the babies there are a total of six at this point. The biggest one must be high up in the herd because she keeps running the others off.
The funny thing is that I now have a deer block on this side of the fence. If the others would just come to it they could eat and she couldn't chase them off. I guess it is nature doing it's thing.