1. He is the Chief Justice of the Supreme Court.

2. He is the chief justice of the Supreme Court.
--------------------
Which one is right? Do we have to capitalize them?

Number 1 is correct since you are using propper nouns.