If you have A + C <--> C + D, and you increase the concentration of A; that means equilibrium will shift to the right. Now does that also mean that concentration of C decreases?

I think you made a typo. You may have meant

A + B ==> C + D

Increasing A shifts the rxn to the right which decreases B and increases C and D.