What is the primary claim made by those who oppose hate crimes legislation?

How is a "hate crime" determined? If someone beats up a man, was it because he was or was it because he stole some money?