The AEO Report

Pillar 01 of 7

Pillar 01

Discoverability.

The plumbing layer — can AI engines find and crawl your site at all?

Discoverability is the foundation. Without it, every other pillar collapses. Discoverability covers the technical plumbing that lets AI crawlers reach, parse, and index your pages — robots.txt, sitemaps, llms.txt, server-side rendering, Bing index inclusion, IndexNow pings, and the agent-specific crawler permissions for GPTBot, ClaudeBot, PerplexityBot, and OAI-SearchBot.

Why it matters

Most brands invisible to ChatGPT don't have a content problem — they have a plumbing problem. If your robots.txt blocks GPTBot, if your site is fully client-side rendered, if your sitemap was never submitted to Bing Webmaster Tools, no amount of editorial polish will make you cited. Discoverability is the prerequisite. Google Lighthouse formalized this in 2026 by adding llms.txt as an audit in its new Agentic Browsing category.

Editorial under this pillar

Key terms in this pillar