### BEGIN FILE ### User-agent: YahooSeeker Disallow: / User-agent: OmniExplorer_Bot Disallow: / User-agent: Slurp Crawl-delay: 20 User-agent: * Disallow: /sitecore/ Disallow: /sitecore modules/ Disallow: /clearcache.aspx Disallow: /layouts/ Disallow: /xsl/ Disallow: /bin/ Disallow: /common/ # The use of robots or other automated means to access the # mycareer.com.au site without the express permission of # Fairfax Digital is strictly prohibited. Notwithstanding # the foregoing, Fairfax Digital may permit automated access # to certain mycareer.com.au pages but solely for the limited # purpose of including content in publicly available search # engines. Any other use of robots or failure to obey the # robots exclusion standards set forth at # http://www.robotstxt.org/wc/exclusion.html is strictly # prohibited. # ### END FILE ###