Is your website optimized for agents?
Today, discovery often begins with LLMs or agents scraping your site for information. We explore common blockers that could force LLMs to use third-party information instead of your site's framing.
What are common problems that make a website less accessible to agents?
Today, we have to build websites for both humans and agents. Humans see design, and flow, and branding.
Agents purely look at the information, structure, and schema.
Here are common challenges B2B brands don’t realize in terms of agent accessibility…
Hover states - Tooltips and hover states are typically invisible to agents going through the site.
Scroll to load - you know that content that only dynamically loads as you scroll? Agents often won’t be able to access that when scraping your website. You can see an example of this on Miro’s website.
Multi-step sign-up forms - especially where captchas, email verification, or required questions are concerned- can be a blocker for agents.
Hidden navigation - there are a lot of structural reasons that putting key content in your main navigation (header and footer) is advantageous. When it comes to agent accessibility, if in Scenario A: you put a comparison article in your footer and in Scenario B: you have “comparisons” as one of 8 options under a “Features” tab, it will be substantially more likely that the agent gets the key info needed in Scenario A.
For more information on the value of footers, see this article we did a few months ago.
Security protocols - Many standard security protocols via systems like Cloudflare will block things like headless fetching, which can force agents to look to third-party information instead of your site’s data.
While security is critical, it is an interesting thought about how this can be balanced with LLM discoverability.
Discovery of the Week
Framer is one of the first sites to introduce a comparison article against Claude Code.
They added it less than a month ago.
It’s already ranking when I ask my ChatGPT, “Should I build a quick site on Framer or just use Claude Code?”
B2B SaaS brands should move quickly here.
The Claude Codes, Lovables and OpenClaws of the world will become competitors whether you are in project management, CRM, page building, or email marketing.
All the major research studies (Ahrefs, AirOps etc) point to the value of comparisons, versus, and "best of" style content for GEO.
While the LLMs still prefer 3rd party references, in lieu of those, they will absolutely use your comparison content (and I have a theory that part of the reason behind third-party prominence is tied to inbound linkage. More people reference third-party comparisons, while few people link to your brand’s comparison page)
But brands like Framer, by moving quickly here, are capturing high-intent traffic that might otherwise go a different route.