cobalt/src/front/robots.txt

mirror of https://github.com/wukko/cobalt.git synced 2024-11-15 20:59:59 +00:00
User-Agent: *
Disallow: /icons/
Disallow: /fonts/
Disallow: /*.js
Disallow: /*.css
moved to new repo 2022-07-08 19:17:56 +01:00			`User-Agent: *`
fix robots.txt currently the robots.txt file is useless because it's interpreted as one path "/icons/ /fonts/ .js .css" (an example path that would be accepted -- and therefore disallowed for robots) by this regex would be `https://cobalt.tools/icons/ /fonts/ bla.js .css`, which is obviously nonsense & useless) 2023-11-10 17:27:18 +00:00			`Disallow: /icons/`
			`Disallow: /fonts/`
			`Disallow: /*.js`
			`Disallow: /*.css`