seo - Using noodp meta tag in a robots.txt file -
is possible add seo tags such 'noodp' robots.txt file instead of using <meta>
tags? trying avoid messing our cms template, although suspect may have to...
could try similar this...
user-agent: * disallow: /hidden sitemap: www.example.com noodp:
i think robots.txt takes precedence on meta tags? noindex instance, crawler not see page in question. noodp however, still case?
you can't robots.txt, can same effect using the x-robots-tag response header.
add appropriate part of .htaccess file:
header set x-robots-tag "noodp"
this tells server include following line in response headers:
x-robots-tag: noodp
search engines (that support x-robots-tag) interpret header line same way interpret 'noodp' in robots meta tag. in general, can put in x-robots-tag header can put in robots meta tag. note page must not blocked robots.txt, otherwise crawler never request page, , therefore never see header.
Comments
Post a Comment