We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent 1fff03b commit 0c02109Copy full SHA for 0c02109
1 file changed
robots.txt
@@ -15,13 +15,25 @@ Disallow: /20*
15
User-agent: ClaudeBot
16
Disallow: /20*
17
18
-User-agent: BardBot
+User-agent: CCBot
19
20
21
-User-agent: J1Bot
+User-agent: cohere-ai
22
23
24
-User-agent: CCBot
+User-agent: AI2Bot
25
+Disallow: /20*
26
+
27
+User-agent: Diffbot
28
29
30
+User-agent: Bytespider
31
32
33
+User-agent: Google-Extended
34
35
36
+User-agent: Applebot-Extended
37
38
39
Sitemap: https://csswizardry.com/sitemap.xml
0 commit comments