Explain why the index of refraction of an object is a physical property?

The index of refraction tells you the speed of light in the material, which has nothing to do with its chemical behavior.