1. I remember when we first met.

2. I remember that we first met.
-----------------------------
Are both grammatical though they are different slightly in meaning?

3. I remember the fact that we first met.
(Is this correct?)

You are correct about 1 and 2.

3 is technically correct, but very awkward.