Is women's history month capitalization?

Yes.

http://womenshistorymonth.gov/about.html