We should either visit the art museum or attend a concert this weekend.

Is this a parallel sentence?

... visit the art museum ... attend a concert

Yes, it's parallel: verb + direct object in both places.

i am both a quick worker and careful

make parallel

Yes, the sentence "We should either visit the art museum or attend a concert this weekend" is an example of a parallel sentence.