1. Oh, my!

2. Oh my!
3. Oh, my God!
4. Oh, my gosh!
---------------------
Is #1 or #2 from #3?
Do we have to put a comma after 'Oh'?

Yes, you need the comma.

1, 3, and 4 are correct.