Yes, the line "my heart broke in Anguish and Anguish my love shattered" is indeed a good example of alliteration. The repetition of the "h" sound in the words "heart," "broke," "Anguish," and "shattered" creates a musical effect and emphasizes the emotional intensity of the line.
