Skip to main content.
home | support | download

Back to List Archive

Re: HTTP spidering - zero results

From: Ron Samuel Klatchko <rsk(at)not-real.corpmail.brightmail.com>
Date: Thu Jun 15 2000 - 20:18:33 GMT
Angel Parn wrote:
> 
> > Could you run swish-e at debug level 3 and send the log to the list.
> 
> Do you mean verbose level 3? This it is:
> 
> The latest version (PHRASEo):
> ------------------
> Indexing Data Source: "HTTP-Crawler"
> Indexing http://www.mysite.com/index.php3?date=2000/06/16..
> retrieving http://www.mysite.com/index.php3?date=2000/06/16 (0)...
> 
> Removing very common words...

Hmm.  This is very odd.  You say you've tried swishspider on that exact
URL and you get all the files.  This just doesn't make sense.

I'd like to try and recreate your exact situation but the URL you've
given does not seem to be real (when I try and view it I get a 302 and
am forwarded to http://ad.webprovider.com/error/404error.html).  Could
you let us know what the actual URL is.

moo
------------------------------------------------------------
        Ron Samuel Klatchko - Senior Software Jester
            Brightmail Inc - rsk@brightmail.com
Received on Thu Jun 15 16:36:43 2000