close open_in_new

Idea

add a card for robots.txt+status
help edit
open

add a card for robots.txt+priority
help edit
low

add a card for robots.txt+tag
help edit
administration

 

add a card for robots.txt+issues

help edit

see http://www.robotstxt.org/

 

add a card for robots.txt+solution

help edit

If *robots.txt exists have it create/update the file at (domain)/robots.txt whenever it's edited.

 

Or, more Wagn-y?:

  1. See if there's a way to succcessfully redirect (domain)/robots.txt to robots.txt?layout=none&view=naked
  2. Put robots.txt, PlainText with some good default content, on en.dwagn.org and link from Config

 

 

add a card for robots.txt+discussion

add a card for robots.txt+discussed in support tickets

help edit

add a card for robots.txt+relevant user stories

help edit