# AutoTickers - robots.txt # https://autotickers.com User-agent: * Allow: / Disallow: /search Disallow: /api/ # Crawl-delay for well-behaved bots Crawl-delay: 1 # AI crawlers — explicitly welcomed for indexing User-agent: GPTBot Allow: / Disallow: /search User-agent: ChatGPT-User Allow: / User-agent: Claude-Web Allow: / User-agent: ClaudeBot Allow: / User-agent: Amazonbot Allow: / User-agent: PerplexityBot Allow: / User-agent: YouBot Allow: / User-agent: Applebot Allow: / User-agent: Bingbot Allow: / User-agent: Googlebot Allow: / User-agent: facebookexternalhit Allow: / User-agent: Twitterbot Allow: / # Sitemaps Sitemap: https://autotickers.com/sitemap-index.xml Sitemap: https://autotickers.com/sitemap-articles.xml # AI/LLM context file (not a sitemap) # https://autotickers.com/llms.txt