Don't start it as soon as you get the necessary number of people required for a minimum start. Try waiting fora while longer, ney?
Well, unless the other people aren't that important. Still, maybe their roles could negatively impact our gaming experience? You know best, since it's your AG and all. But wouldn't it be a waste to throw them away?