Why is the atmosphere pressure lower on a high mountain peak than at sea level?

Because the column of air is not as high (nor as dense) which means it has less weight.