Skip to main content.
home | support | download

Back to List Archive

Re: [swish-e] all URLs

From: Peter Karman <peter(at)not-real.peknet.com>
Date: Mon Feb 04 2008 - 14:03:47 GMT
On 02/04/2008 07:16 AM, Alexander Dolgarev wrote:
> Yet again, I've reinstalled swish-e (version 2.4.5) and have the same
> effect (or defect):
> 
> Summary for: <SOME_URL>
>      Connection: Close:      3  (0.0/sec)
> Connection: Keep-Alive:    224  (1.2/sec)
>             Duplicates:     60  (0.3/sec)
>         Off-site links:     14  (0.1/sec)
>            Total Bytes: 74,442  (402.4/sec)
>             Total Docs:    226  (1.2/sec)
>            Unique URLs:    227  (1.2/sec)
>              text/html:      1  (0.0/sec)
> All files are suggested by spider.pl to be duplicates. Note that now
> I've tried also on 3rd party site. Any suggestions?
> 

try setting 'use_md5' to false ?

-- 
Peter Karman  .  peter(at)not-real.peknet.com  .  http://peknet.com/

_______________________________________________
Users mailing list
Users@lists.swish-e.org
http://lists.swish-e.org/listinfo/users
Received on Mon Feb 4 09:03:48 2008