Challenges in detecting black holes