bgme/mastodon
1
0
Fork 0
mirror of https://github.com/yingziwu/mastodon.git synced 2026-02-04 03:25:14 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions 13

Allow archive.org

Browse source
This commit is contained in:
bgme 2021-09-13 12:55:11 +08:00
parent 7cae14482d
commit 2bd2b5b391
1 changed files with 4 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

4
public/robots.txt
View file

@ -1,5 +1,9 @@
# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
User-agent: archive.org_bot
Disallow: /media_proxy/
Disallow: /interact/
User-agent: *
Disallow: /
Disallow: /media_proxy/