You are looking at a balance of two energies, and your atom will, of course, pick the lowest.
First, the s orbital is lower energy than the d orbital.
Second, having a half-filled orbital shell gives you a small lowering of energy.
In general, the s level is close enough to the d level that the small lowering of energy for a half filled s level and a half filled d level is enough that the transition from ns
2(n-1)d
4 to ns
1(n-1)d
5 is favorable. You give up a little energy from the difference in s and d, but pick up a little more from having two half filled shells. If you are starting with only five electrons, however, you are losing the energy difference of two electrons going into s instead of d, not just one, and only picking up the half filled bonus for the d shell, not the s shell. The process you are looking at is ns
2(n-1)d
3 to ns
1(n-1)d
4 to ns
0(n-1)d
5, and neither of those steps is favorable energetically.
I hope that description made sense to somebody besides me