.htaccess - Magento robots.txt 404s -
i have magento multi-site installation. want disallow 1 of stores, not others. trying take advantage of "default robots" option on magento config, left default robots "index,follow" stores except 1 want disallow, changed "noindex,nofollow". when go my-url/robots.txt, 404 error.
any idea why might 404?
can point in direction of how might make robots.txt disallows 1 site?
this setting add meta robots tag pages, e.g.
<meta name="robots" content="index,follow" /> see: http://www.robotstxt.org/meta.html
the magento application not interface robots.txt
Comments
Post a Comment