Skip to main content.
home | support | download

Back to List Archive

Re: Callback Functions For Indexing

From: Bill Moseley <moseley(at)not-real.hank.org>
Date: Fri Jan 27 2006 - 15:22:19 GMT
On Fri, Jan 27, 2006 at 06:30:56AM -0800, andy rosbrook wrote:
> Is there anyway to use a callback function to catch errors when spidering 
> websites with spider.pl?
> 
> I am currently spidering only a few small sites at a time and need a way of 
> knowing weather the spider successfully indexed the site or not, is this 
> possible? if so is there a way of grabbing the error message into perl?

Not sure what you mean.  You want to know if any file returned a
non-200 status?  Or if swish-e indexed any words?


IPC::Open3 will capture stderr and stdout.

-- 
Bill Moseley
moseley@hank.org

Unsubscribe from or help with the swish-e list: 
   http://swish-e.org/Discussion/

Help with Swish-e:
   http://swish-e.org/current/docs
   swish-e@sunsite.berkeley.edu
Received on Fri Jan 27 07:22:24 2006