On Wed, 15 Jan 2003, Michael wrote:

> there are often the same link in result of swish.
> exemple :
> this one
> http://F4i.fr/inform/Documentation/index.php?PHPSESSID=3a06066df32fb4ff48dee
> and this http://F4i.fr/inform/Documentation/?PHPSESSID=3a06066df32fb4ff48dee
> 
> are both identical.

No, they are not identical.

> is there any option to remove this bug ?

Check out the use_md5 option in spider.pl or fix your links to be
consistent.

I'd think you would want to strip off the session id, too.  


-- 
Bill Moseley moseley@hank.org