This is one of the first problems I ran into as well. I solved it by making
the search string in swishspider less strict. From:

if ($response->header("content-type") eq "text/html") {

I changed it into:

if ($response->header("content-type") =~ /text\/html/i) {

That way it accounts for any additional text in the Content-Type. Solved.

- Mark

        System Administrator Asarian-host.org


----- Original Message -----
From: "David Norris" <dave@webaugur.com>
To: "Multiple recipients of list" <swish-e@sunsite.berkeley.edu>
Sent: Monday, June 12, 2000 1:14 PM
Subject: [SWISH-E] Re: HTTP spidering - zero results


> Angel Parn wrote:
> > Lynx response:
> > Content-Type: text/html
> > Seems bad. What I have to do ?
>
> Well, I am stumped.  Hopefully someone else will have a good answer.
> I'm not extremely familiar with the spider. (other than wanting to rip
> out my hair every time I try to use it ;-)
>
> Half of the errors seem to be related to PERL being brain-dead and the
> other half minor config errors.  At this point I'd hate to guess which.