Can I use the term "out of town" to indicate that I am traveling to a different country?

Yes. However, it would be more accurate if you said that you'd be out of the country.