Skip to main content.
home | support | download

Back to List Archive

24 hours of spidering and still going

From: Don Fike <fike(at)not-real.cs.utk.edu>
Date: Fri Aug 17 2001 - 18:00:32 GMT
Hello,

I used the simplest example given for the use of prog spidering yesterday
about this time.
It's still going and this file, prog_icl_external.index.prop.temp, has just
reached 50 meg.
The site that it was to spider has about 4000 files, would you say this
behavior is normal?
Is it September 9th yet?

Thanks,

Don

-------------------
  Don Fike
  ICL/UTK
  fike@cs.utk.edu
  865-974-0531
-------------------
Received on Fri Aug 17 18:01:02 2001