Skip to main content.
home | support | download

Back to List Archive

Re: Spider

From: Mike Downey <downeym(at)not-real.algonquincollege.com>
Date: Thu Feb 24 2000 - 01:18:20 GMT
Could it be the SWISHSPIDER hasn't been patched? I noticed: <meta HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1"> in the head of the document and that stopped my indexing until I acquired the latest version of the spider....


----- Original Message ----- 
From: Ron Samuel Klatchko <rsk@brightmail.com>
To: Multiple recipients of list <swish-e@sunsite.berkeley.edu>
Sent: Wednesday, February 23, 2000 5:00 PM
Subject: [SWISH-E] Re: Spider


> PropheZine Owner wrote:
> > I finally have the spider working.  Well, almost.
> > 
> > I have tried all combinations for the IndexDir entry to get the spider to
> > index my entire web site.
> > 
> > If I use  http://www.prophezine.com/  it only indexes the index.shtml page.
> > I tried http://www.prophezine.com/index.shtml  and it still only indexes the
> > index.shtml page.
> 
> I just invoked swishspider manually on that URL and it worked properly. 
> Perhaps something else in your config is incorrect.  Try running
> swishspider with an IndexReport level of 3 and see what it says.
> 
> moo
> ------------------------------------------------------------
>            Ron Samuel Klatchko - Software Jester
>             Brightmail Inc - rsk@brightmail.com
> 
Received on Wed Feb 23 20:22:10 2000