We've been balancing the armies that towns send to hunt you to create a meaningful tradeoff between two types of risk:

a) the risk of progressing too quickly on map, resulting in instant death

b) the risk of waiting too long, resulting in not being strong enough to fight off an army that is sent from a hostile town to hunt you later in the game.