I was just curious is touching someone on the chest when someone is yelling at you without consent illegal?

How are you touching them? Is the person male or female? These factors would make a difference.