is "places to go" mean "endroit à aller"? and does that sound natural

Yes, "places to go" can be translated as "endroit à aller" in French. However, it is more common to say "endroits à visiter" to convey the same meaning. So, "endroits à visiter" would sound more natural.