what makes a probability plot non-normal?

I would think outliers are one of them, but what else?

A normal distribution approximates a bell-shaped curve. Outliers to one side would skew the distribution. If the distribution was flat, having about the same frequencies throughout the distribution, this would be non-normal. Also a bimodal distribution would be non-normal, suggesting two underlying, overlapping normal distributions.