Skip to main content.
home | support | download

Back to List Archive

Re: Limiting indexing

From: Bill Moseley <moseley(at)not-real.hank.org>
Date: Wed Jul 03 2002 - 18:31:09 GMT
At 11:19 AM 07/03/02 -0700, Jody Cleveland wrote:
>I had posted this same question a few weeks ago, and I'm about ready to give
>up and just deal with the fact it's indexing more than I'd like. I've got my
>site at winnefox.org/wals/new Problem is, it indexes everything in
>winnefox.org (which is an entirely different department) as well as
>everything in the wals folder. I've spent hours looking over the help
>section at the bottom of spider.pl for all the references to call-back and
>test_url and I'm just not getting it. Are there any example's anywhere that
>explain this more plainly/ step-by-step? Kind of like a dummies guide?

Are you using spider.pl (-S prog) or the -S http method?



-- 
Bill Moseley
mailto:moseley@hank.org
Received on Wed Jul 3 18:34:36 2002