1. Cleaning is good exercise, too.

2. Cleaning is a good exercise, too.
---------------------
Do we have to use 'a' or not? Which one is correct? Are both correct?

Both are correct.