Do I have to go back home?

1. Yes, you do.
2. No, you don't
3. Yes, you have to.
4. No, you don't have to.

Are all the answers correct?
Can we answer like #1 and #2?

They are all correct, but the first two are better.