It basically comes down to:
If your army is gunna always be out, youll want most of your offensive army as off specs then the rest elites/def specs. If they'll always be at home you'll want def specs.
If your keeping them home a lot but do want to do big attacks when the chance arises, youll want elites.
Depending on where you are in the spectrum, youll want a portion of each unit type.