# robots.txt for forum.agoraroad.com (Agora Road's Macintosh Cafe) # Proposed 2026-10-14. The forum does not use friendly URLs, so every forum page is # /index.php?/ and the rules below match that form. User-agent: * Content-Signal: search=yes, ai-input=yes, ai-train=no # admin + account pages (members only, nothing to index) Disallow: /admin.php Disallow: /install/ Disallow: /index.php?account/ Disallow: /index.php?conversations/ Disallow: /index.php?login/ Disallow: /index.php?logout/ Disallow: /index.php?lost-password/ Disallow: /index.php?register/ # lists that repeat thread content or are closed to guests Disallow: /index.php?search/ Disallow: /index.php?whats-new/ Disallow: /index.php?find-threads/ Disallow: /index.php?online/ Disallow: /index.php?members/ Disallow: /index.php?misc/ # redirects and buttons (each one just sends the crawler to a thread page again) Disallow: /index.php?goto/ Disallow: /index.php?*/latest Disallow: /index.php?*/unread Disallow: /index.php?*/reactions Disallow: /index.php?*/reply Disallow: /index.php?*/post-thread Disallow: /index.php?*/watch Disallow: /index.php?*/report # threads, boards, pages, media, attachments, tags, help, css.php and js stay open # AI training crawlers (matches ai-train=no; Cloudflare already blocks GPTBot and CCBot). # Search/answer bots (OAI-SearchBot, ChatGPT-User, PerplexityBot, Claude-SearchBot, # Claude-User, Googlebot, Bingbot, Applebot) are NOT listed here, so they follow the rules above. User-agent: GPTBot User-agent: CCBot User-agent: ClaudeBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bytespider User-agent: meta-externalagent Disallow: / Sitemap: https://forum.agoraroad.com/sitemap.xml