Skip to content

Feature crawler coverage, speed guarantees and AEO in the listing - #16

Merged
henry-mosh merged 1 commit into
mainfrom
copy/feature-coverage-and-speed
Sep 3, 2026
Merged

Feature crawler coverage, speed guarantees and AEO in the listing#16
henry-mosh merged 1 commit into
mainfrom
copy/feature-coverage-and-speed

Conversation

@henry-mosh

Copy link
Copy Markdown
Collaborator

Summary

Adds three things the readme/banner under-sold, corrects one FAQ answer that 1.2.0's page enhancements make false, and puts AEO in the hero. Stacked on and now clean against #15 (merged).

  • Crawler coverage bullet — names the registry (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, GoogleOther, Amazonbot, Bytespider, CCBot, meta-externalagent, MistralAI-User, DuckAssistBot and more) and the daily refresh, so "will this still work in six months" has an answer.
  • "Never makes a visitor wait" — the cache-only render guarantee, scoped correctly (see below) and given its own FAQ entry: "Will it slow my site down?"
  • "Is this cloaking?" FAQ entry — states the distinction search engines actually draw, and where Google sits on each side of it.
  • The "will visitors see the optimized version" FAQ answer corrected for 1.2.0. It previously ended "The visible page is never altered," which page enhancements make false. Now names both visible additions (metadata, page enhancements) and states the real invariant: nothing shown to a crawler is withheld from a person.
  • AEO in the hero — banner eyebrow (AEO · AI CRAWLERS · SEO METADATA), the short description, and the Description's opening sentence, matching how citecue2's own content (the AEO pillar post, GEO/AEO/SEO framing) already uses the term.

Caught by Codex review, fixed here

The first draft overclaimed in three places; codex:review caught all three, verified against source before fixing:

  1. "Cannot slow your site down" was false for crawlers. Citecue_Proxy::decide() makes a synchronous lookup for a recognised crawler (only a bot is waiting, so this is deliberate) and can spend up to the 3-second serve timeout before the circuit breaker trips. The cache-only guarantee is real for the visitor render path only — the bullet and FAQ answer now say so explicitly, including the bound (3s timeout, per-minute budget, circuit breaker).
  2. "Never to Google" was wrong. GoogleOther — which Google uses for its AI products — is in the bundled registry and is served the optimized page; it's advertised two lines above this same answer. Googlebot (Search) is not in the registry. The FAQ now names both and says which is which.
  3. The cloaking answer omitted page enhancements, the one visible thing the question is actually about, and so contradicted the neighbouring answer this same PR had just corrected.

Verified against includes/class-citecue-crawlers.php before writing the correction: Googlebot is absent from bundled_tokens(), which holds exactly the 18 entries the copy claims.

Verification

  • 382 tests green (core, WooCommerce-stub, multisite)
  • phpcs and composer lint clean
  • Banner rebuilt via assets-src/build-assets.sh, dimensions asserted

Note for whoever pushes to SVN next

This PR's readme changes describe 1.2.0 (page enhancements, 18-crawler registry, AEO framing) and must not be copied onto the currently-published 1.1.2 listing — none of that is true of the code that version ships. The one exception already pushed separately: Tested up to: 7.1, which is true of every published version and was pushed to SVN readme-only, ahead of this merging.

🤖 Generated with Claude Code

Three claims in the new copy outran the implementation. Codex caught all
three; each is a case of documentation describing the design's intent rather
than its behaviour.

"Cannot slow your site down" was false on the crawler path. The cache-only
guarantee belongs to the render that serves a person; Citecue_Proxy::decide()
deliberately makes a synchronous lookup for a recognised crawler, because only
a bot is waiting there, and can spend up to the three-second serve timeout
before the circuit breaker trips. The bullet is now "Never makes a visitor
wait", which is the guarantee that actually holds, and it states the crawler
exception and its bounds rather than hiding it.

"Never to Google" was wrong in the one place it mattered. GoogleOther is in
the bundled registry and is advertised two lines above and on the banner, so
the optimized page IS served to a Google crawler. The answer now separates the
two: GoogleOther, which Google uses for its AI products, is served; Googlebot,
which crawls for Search, is not in the registry and gets the ordinary page.

And the cloaking answer omitted the only visible thing the question is about.
It said a reader sees the page plus additive metadata, which contradicted both
the feature list and the neighbouring FAQ answer this same branch had already
corrected for 1.2.0. Page enhancements are now named there, alongside the
point that matters: a reader and Googlebot receive identical bytes.

Verified rather than assumed: Googlebot is absent from bundled_tokens(), which
holds exactly the 18 entries the description claims, and the per-minute lookup
budget and three-second timeout are both real.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
@henry-mosh
henry-mosh merged commit 879251c into main Sep 3, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant