We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
1 parent de7184c commit dc36ca1Copy full SHA for dc36ca1
1 file changed
robots.txt
@@ -1,9 +1,13 @@
1
User-agent: *
2
Allow: /
3
4
-# Block GPTBot from accessing articles. This is a little brittle, but it works
5
-# on the basis that all my blog posts were published at some point in the 21st
6
-# century. TODO: Update when I’m 109.
+# Block AI bots from accessing articles for training purposes.
+#
+# This is a little brittle, but it works on the basis that all my blog posts
7
+# were published at some point in the 21st century.
8
9
+# TODO: Update when I’m 109.
10
+
11
User-agent: GPTBot
12
Disallow: /20*
13
0 commit comments