Skip to main content.
home | support | download

Back to List Archive

Re: Limit indexing to base_url

From: Bill Moseley <moseley(at)>
Date: Sat Dec 06 2003 - 22:03:36 GMT
On Sat, Dec 06, 2003 at 12:54:36PM -0800, John Angel wrote:
> How to limit indexing to base_url?
> E.g. if base_url  => 'http://localhost/something/'
> I do not want to index anything beside that directory. Meaning I do not want
> to index http://localhost/someother/
> I know it can be done with test_url(), but it should be attribute for
> server.
> Feature request :)

Try searching the archives.  Perhaps with the keywords:

   spider limit path

Also, try the documentation:

read about test_url.  If that's still not clear please post back with 
comments about what was not clear so I can update the docs.


Bill Moseley
Received on Sat Dec 6 22:03:40 2003