# Tells Scanning Robots Where They Are (And Are Not) Welcome # User-agent: Can specify by name or sue "*" for everyone # Disallow: Block robots if this matches first part of requested path, # Allow: Overrodes Disallow for specific files or paths # User-agent: * Disallow: /misc Disallow: /stats.html Disallow: /testpage.html Disallow: /testboxes.html Disallow: /template.html Disallow: /testpage.asp Disallow: /report.html Disallow: /report-left.html Disallow: /report-top.html Disallow: /report-left.html Disallow: /testquiz.asp Disallow: /testdbquiz.asp