Skip to main content.
home | support | download

Back to List Archive

Re: Callback Functions For Indexing

From: andy rosbrook <andy_rosbrook(at)>
Date: Fri Jan 27 2006 - 17:46:21 GMT
Well i just want to know after each URL in spider.config weather the 
spidering was a success or a failure. I know i could just check for a 
complete index.swish-e but this doesnt allow me to capture any error 

Ill take a look at grabbin STDERR though, thanks.

>From: Bill Moseley <>
>To: Multiple recipients of list <>
>Subject: [SWISH-E] Re: Callback Functions For Indexing
>Date: Fri, 27 Jan 2006 07:21:45 -0800 (PST)
>On Fri, Jan 27, 2006 at 06:30:56AM -0800, andy rosbrook wrote:
> > Is there anyway to use a callback function to catch errors when 
> > websites with
> >
> > I am currently spidering only a few small sites at a time and need a way 
> > knowing weather the spider successfully indexed the site or not, is this
> > possible? if so is there a way of grabbing the error message into perl?
>Not sure what you mean.  You want to know if any file returned a
>non-200 status?  Or if swish-e indexed any words?
>IPC::Open3 will capture stderr and stdout.
>Bill Moseley
>Unsubscribe from or help with the swish-e list:
>Help with Swish-e:

Are you using the latest version of MSN Messenger? Download MSN Messenger 
7.5 today!
Received on Fri Jan 27 09:46:24 2006