It is easier to calculate

It has 'heavier tails' to account for the extra uncertainty in estimating $\sigma$

The z-distribution cannot be used for $n < 100$

The t-distribution is always more accurate