Skip to main content.
home | support | download

Back to List Archive

Re: Does the <!-- Swishcommand noindex --> work whe

From: Bill Moseley <moseley(at)not-real.hank.org>
Date: Wed Jun 25 2003 - 17:34:12 GMT
On Wed, Jun 25, 2003 at 11:02:34AM -0500, Cleveland@mail.winnefox.org wrote:
> > I assume you mean you are running IIS on the Windows machine?
> 
> Unfortunately, yes.
> 
> > Do you see the request for robots.txt in the IIS access log? 
> 
> I did find this:
> 2003-06-25 14:22:53 199.242.176.169 - W3SVC22 FORGE 199.242.176.172 80
> GET /robots.txt - 200 0 279 213 0 HTTP/1.1 www.oshkoshpubliclibrary.org
> swish-e+spider+2.2+http://swish-e.org/ - -
> 
> > Maybe you need a line feed after that line?
> 
> I added one in there, but it still indexes that pdf file.

Ah, yes.  remove your blank lines.  A blank line separates sections 
based on the user agent.  



-- 
Bill Moseley
moseley@hank.org
Received on Wed Jun 25 17:34:18 2003