head 1.1; access ; symbols ; locks ;comment @@; 1.1 date 2014.11.11.10.18.19; author p4; state Exp; branches ; next ; desc @@ 1.1 log @@ text @# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # # To ban all spiders from the entire site uncomment the next two lines: # User-agent: * # Disallow: / @