# Define access-restrictions for robots/spiders # http://www.robotstxt.org/wc/norobots.html # Modified 6.8.2010 CDOT Web Team # allow crawlers to all content except forms that # are repeated for each piece of content in the site User-agent: * Disallow: Disallow: /*sendto_form$ Disallow: /*folder_factories/ Sitemap: http://www.coloradodot.info/sitemap.xml.gz