Why is it difficult to recognize the worth and dignity of all individuals at all times?

There are as many reasons for that as there are individuals.

You can begin with family values, ethnicity, education, area of the country, religious background, friends..etc., etc., etc.