Skip to main content.
home | support | download

Back to List Archive

Re: on spidering

From: Bill Moseley <moseley(at)not-real.hank.org>
Date: Mon Oct 27 2003 - 00:15:38 GMT
On Sun, Oct 26, 2003 at 11:34:01AM -0800, Tech Support FaenWorks wrote:
> Question:: when I'm spidering... it doesn't seem to be "spidering =
> correctly".  It's going in 5 deep to the directories that I give it, but =
> AREN"T following the htmls inside the files.... example.
> 
> if it has as a primary location http:// www.mysite.com it's not also =
> indexing my links to www.othersite.org
> clear or unclear?

Did you tell the spider that www.othersite.org is yours, too?


-- 
Bill Moseley
moseley@hank.org
Received on Mon Oct 27 00:27:52 2003