# llms.txt for thesubdial.com # This file specifies permissions for AI crawlers regarding content usage for training LLMs. # For more information, visit: https://llms.txt # Default policy: Disallow all LLM crawlers unless explicitly allowed below. User-Agent: * Disallow: / # OpenAI GPTBot User-Agent: GPTBot Allow: / # Anthropic ClaudeBot User-Agent: ClaudeBot Allow: / # Google AI crawlers (Google-Extended) User-Agent: Google-Extended Allow: / # Perplexity AI User-Agent: PerplexityBot Allow: / # Common Crawl User-Agent: CCBot Allow: / # Note: # Allowing these bots can increase your content visibility in AI-powered platforms.