The word "pledge" in this context means to promise or offer as a token of dedication or loyalty. So when the speaker says "I will pledge with mine Song to Celia," it means they are promising to express their love and devotion to Celia through the medium of music/song.
