# Robots.txt file from http://www.123internetdesigns.com # # All robots will spider the domain User-agent: * Disallow: /admin/ Disallow: /cms/ Disallow: /hosting/ Disallow: /development/ Disallow: /files/ Disallow: /tracking/