Will buying bonds decrease the money supply?

Depends on who is buying the bonds. If the Fed, then no, if the public, then yes.