Question

Could you potentially use up all of your memory B and T cells for a specific antigen and become susceptible to that antigen again?

Answer 1

No, that is why they are called memory B-cells. They remember that specific infection and respond accordingly.