# Exclusion definitions for "GoogleBot" and other search engines / web crawlers # ____________ webmaître # | robots.txt | # ¯¯¯¯¯¯¯¯¯¯¯¯ Detectivebureau "Mystic" # _____________________________________________________________________________ # Version Date By Description # ----------------------------------------------------------------------------- # 1·0·0 2006-01-12 HBr/DA Created. # 2·0·0 2007-06-01 HBr/DA Updated. # ¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯ User-agent: * # attention all robots: # content-provider & web-author: Disallow: /*.css$ Disallow: /*.dat$ Disallow: /*.doc$ Disallow: /*.JS$ Disallow: /*.pdf$ Disallow: /*.php$ Disallow: /*.rtf$ Disallow: /*.swf$ Disallow: /*.TTF$ Disallow: /*.wri$ Disallow: /*.xsl$ Disallow: /_vti_cnf/ Disallow: /audio/ Disallow: /beacons/ Disallow: /calendar/ Disallow: /cgi-bin/ Disallow: /error/ Disallow: /filedate.php* Disallow: /icons/ Disallow: /images/ Disallow: /JavaApplets/ Disallow: /statistics/ Disallow: /stats/ Disallow: /usage/ Disallow: /video/ Disallow: /vhosts/ Disallow: /w3c/ Disallow: /WEB-INF/ #