SuperbeeLavaman/www
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

y'know I probably should have uploaded this to gh sooner

Browse Source
This commit is contained in:
Logan Joy-Koer
2026-06-22 23:53:22 -07:00
commit b55d3306c4
62 changed files with 1002233 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
blocked_agents.txt
+17
View File
@@ -0,0 +1,17 @@
Googlebot
Bingbot
GPTBot
Claude-Web
ClaudeBot
CCBot
FacebookBot
Applebot-Extended
Applebot
Diffbot
Googlebot-Image
Googlebot-Video
Slurp
DuckDuckBot
Baiduspider
YandexBot
HTTrack