Mozilla/robots.txt at 101dcafe9ad0aa7348e01bfacb3cfd254ecc2864 - Mozilla - Befator Inc: Git

Bommels05/Mozilla

endico%mozilla.org a43f96a5ea If the application is set up at the server root (e.g. bugzilla.mozilla.org) then this robots.txt disallows robots from scanning the site except for the top level file.

git-svn-id: svn://10.0.0.236/trunk@75073 18797224-902f-48f8-a5cc-f745e15eee43

2000-07-28 21:28:41 +00:00

5 lines

70 B

Plaintext

Raw Blame History

 User-agent: *
 Allow: /index.html
 Allow: /cvsqueryform.cgi
 Disallow: /