User-agent: * Disallow: /WebResource.axd Disallow: /query/ User-agent: Ocelli Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SofyaBot Disallow: / User-agent: ShapBot Disallow: / User-agent: GPTBot Crawl-delay: 9 User-agent: ChatGPT-User Crawl-delay: 9 User-agent: ClaudeBot Crawl-delay: 9 User-agent: Amazonbot Crawl-delay: 9 User-agent: PetalBot Crawl-delay: 9 User-agent: googlebot-news Disallow: /awards/ Disallow: /tmc/whitepapers/ Disallow: /webinar/ #Disallow: /tmc/ebooks/ #Disallow: /news/ #Disallow: /tmc/videos/ #Disallow: /tmclabs/ #Disallow: /usubmit/ # rvh - unified all-sites robots.txt