>I stumbled on something that could be a bug: the spider did not follow
>links in my file as long as it's header contained the tag:
><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">
>(the line was included by some html generator)
>Sounds weird isn't it? 
>                           
I'm in the same situation, the spider doesn't follow some
links. I thougth it was my problem, but maybe it will be one
bug.
Does anybody know how to fix????
                                                        Ibon