Skip to content

Update the CrawlerProtection extension - #690

Merged
cicalese merged 1 commit into
masterfrom
update-CrawlerProtection-rr-1cddaaa
Aug 1, 2026
Merged

Update the CrawlerProtection extension#690
cicalese merged 1 commit into
masterfrom
update-CrawlerProtection-rr-1cddaaa

Conversation

@cicalese

@cicalese cicalese commented Aug 1, 2026

Copy link
Copy Markdown
Contributor

Moves the Recommended Revisions pin from 344e7b3 to 1cddaaa.

RR commit Change
1cddaaa CrawlerProtection 1.7.0 (RR #36)

CrawlerProtection 1.7.0 over the pinned 1.5.0:

  • Protection is skipped in CLI and maintenance context. A maintenance script re-parsing a page that transcludes a protected special page tripped the anonymous-user check and denied itself; this is the only change that affects a wiki configuring nothing.
  • api.php and rest.php entry points can now be protected, via $wgCrawlerProtectedApiModules and $wgCrawlerProtectedRestPaths. Both default to empty, so they are inert until configured.
  • The IP allowlist matches on the canonical request IP, with opt-in $wgCrawlerProtectionTrustXForwardedFor for wikis whose proxy is not in $wgCdnServersNoPurge, and $wgCrawlerProtectionTreatTempUsersAsAnon for temporary accounts.
  • New CrawlerProtectionShouldDeny hook for a bespoke access policy; denials are marked noindex,nofollow; the raw denial text moved to a message key, so it is translatable.

Every new setting defaults to off or empty, and requires stays MediaWiki >= 1.39.4.

Goes in ahead of the 3.5.20 release PR, which will then carry only the base image pin, VERSION and the release note.

Fixes #689

Moves the Recommended Revisions pin from 344e7b3 to 1cddaaa, which carries
CrawlerProtection 1.7.0 in place of 1.5.0.

The change that reaches a wiki configuring nothing is that protection is now
skipped in CLI and maintenance context: a maintenance script re-parsing a page
that transcludes a protected special page used to trip the anonymous-user check
and deny itself. The rest is opt-in — api.php and rest.php entry points can be
protected via CrawlerProtectedApiModules and CrawlerProtectedRestPaths, both
empty by default; the IP allowlist gains CrawlerProtectionTrustXForwardedFor
and CrawlerProtectionTreatTempUsersAsAnon; and a CrawlerProtectionShouldDeny
hook allows a bespoke access policy.
@cicalese cicalese mentioned this pull request Aug 1, 2026
@cicalese
cicalese requested a review from yaronkoren August 1, 2026 13:38
@github-actions

github-actions Bot commented Aug 1, 2026

Copy link
Copy Markdown

🐳 The image based on 3c33b3f7 commit has been built with 1.43.9-20260801-690 tag as ghcr.io/canastawiki/canasta:1.43.9-20260801-690

@cicalese
cicalese merged commit c8b15ea into master Aug 1, 2026
3 checks passed
@cicalese
cicalese deleted the update-CrawlerProtection-rr-1cddaaa branch August 1, 2026 14:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Update CrawlerProtection to 1.7.0

2 participants