On Sun 29 Aug 2004, James Green <jkg(a)earth.li> wrote:
It occurs to me that there's very little point in
crawling certain pages of an OpenGuide - anything with "action=edit" or
"action=delete" in the URL, at the very least, has no real value to
someone searching for information. [...]
It's been suggested to me that ``<meta robots="noindex">''
tags in the
<head> of a page are effective here, [...]
I made a start on this; see for example
Questions: (a) where else on http://london.openguides.org/kakemirror/index.cgi
do we need these tags (please do check they're not already there before
spitting out suggestions),
(b) am I doing the tags right.