On Fri, Jan 27, 2006 at 06:30:56AM -0800, andy rosbrook wrote:
> Is there anyway to use a callback function to catch errors when spidering
> websites with spider.pl?
>
> I am currently spidering only a few small sites at a time and need a way of
> knowing weather the spider successfully indexed the site or not, is this
> possible? if so is there a way of grabbing the error message into perl?
Not sure what you mean. You want to know if any file returned a
non-200 status? Or if swish-e indexed any words?
IPC::Open3 will capture stderr and stdout.
--
Bill Moseley
moseley@hank.org
Unsubscribe from or help with the swish-e list:
http://swish-e.org/Discussion/
Help with Swish-e:
http://swish-e.org/current/docs
swish-e@sunsite.berkeley.edu
Received on Fri Jan 27 07:22:24 2006