Mirrors/cobalt
1
0
Fork 0
mirror of https://github.com/wukko/cobalt.git synced 2024-07-01 11:26:47 +01:00
Code Issues Packages Projects Releases Wiki Activity

fix robots.txt

Browse source 
currently the robots.txt file is useless because
it's interpreted as one path "/icons/ /fonts/ *.js *.css"
(an example path that would be accepted -- and therefore disallowed
for robots) by this regex would be `https://cobalt.tools/icons/ /fonts/ bla.js .css`,
which is obviously nonsense & useless)
This commit is contained in:
dumbmoron 2023-11-10 18:27:18 +01:00
parent 463ece02c7
commit d936dd73fe
No known key found for this signature in database
GPG key ID: C59997C76C6A8E5F
1 changed files with 4 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

5
src/front/robots.txt
View file

@ -1,2 +1,5 @@
User-Agent: *
Disallow: /icons/ /fonts/ *.js *.css
Disallow: /icons/
Disallow: /fonts/
Disallow: /*.js
Disallow: /*.css