1. He gave the gold bracelet to me for my birthday.

2. He gave the gold bracelet to me on my birthday.
----------------
What is the difference between the two sentences.

For #2, he gave it on the very birthday.
For #1, he may have given it on the very birthday or on another day. Am I right?

Yes, your interpretation of the two sentences is correct.

=)