# robots.txt for aisecurityguard.io User-agent: * Allow: / # Sitemap for content discovery Sitemap: https://aisecurityguard.io/sitemap.xml # LLM-specific content guide # See /llms.txt for structured site overview # Builder tools (browser-based utilities) Allow: /tools Allow: /tools/ Allow: /api/data/tools/tools-registry.json # API endpoints - allow discovery but crawlers shouldn't hammer them Allow: /v1/skill.md Disallow: /v1/support # Agent discovery Allow: /.well-known/agent # See also: /agents.txt for AI agent integration details # AID record: _agent.aisecurityguard.io (DNS TXT)