robots.txt

• text file on website that tells web robots like engine crawlers not to go to this certain part of the website

• can reveal hidden parts of the website, expose vulnerabilities