When the sample size is very large ($n > 1000$).

When the population standard deviation $\sigma$ is known.

When the population standard deviation $\sigma$ is unknown and the sample size is small.

When the data is perfectly normally distributed.