On Fri, Sep 24, 2004 at 03:30:53PM -0700, Anthony Baratta wrote:
> 	http://test.portofoakland.com/PDF_TestPage.html

BTW -- 

Summary for: http://test.portofoakland.com/PDF_TestPage.html
     Connection: Close:         9  (0.0/sec)
Connection: Keep-Alive:        46  (0.0/sec)
               Skipped:         9  (0.0/sec)
           Total Bytes: 1,430,225  (615.2/sec)
            Total Docs:        47  (0.0/sec)
           Unique URLs:        56  (0.0/sec)

Here's the rest of the output:

moseley(at)not-real.bumby:~$ SPIDER_DEBUG=skipped /usr/local/lib/swish-e/spider.pl default http://test.portofoakland.com/PDF_TestPage.html > spider.out
/usr/local/lib/swish-e/spider.pl: Reading parameters from 'default'

 -- Starting to spider: http://test.portofoakland.com/PDF_TestPage.html --
-Skipped http://test.portofoakland.com/pdf/boar_shee_040907.pdf: Document exceeded 5000000 bytes
Request for 'http://test.portofoakland.com/pdf/boar_shee_040907.pdf' aborted because: 'too big!'
-Skipped http://test.portofoakland.com/pdf/boar_shee_040803.pdf: Document exceeded 5000000 bytes
Request for 'http://test.portofoakland.com/pdf/boar_shee_040803.pdf' aborted because: 'too big!'
Error (37758): Missing 'endstream'
Error (1018026): Missing 'endstream'
Error (1140355): Missing 'endstream'
Error (1580125): Missing 'endstream'
Error (2048547): Missing 'endstream'
Error (2205177): Missing 'endstream'
Error (2282408): Missing 'endstream'
-Skipped http://test.portofoakland.com/pdf/boar_shee_040706.pdf: Document exceeded 5000000 bytes
Request for 'http://test.portofoakland.com/pdf/boar_shee_040706.pdf' aborted because: 'too big!'
-Skipped http://test.portofoakland.com/pdf/boar_shee_040608.pdf: Document exceeded 5000000 bytes
Request for 'http://test.portofoakland.com/pdf/boar_shee_040608.pdf' aborted because: 'too big!'
Error (1236962): Missing 'endstream'
Error (1332472): Missing 'endstream'
Error (2335999): Missing 'endstream'
-Skipped http://test.portofoakland.com/pdf/boar_shee_040504.pdf: Document exceeded 5000000 bytes
Request for 'http://test.portofoakland.com/pdf/boar_shee_040504.pdf' aborted because: 'too big!'
Error (812391): Missing 'endstream'


Error (1007420): Missing 'endstream'
Error (1872412): Missing 'endstream'
Error (3084112): Missing 'endstream'
Error (3454246): Missing 'endstream'
Error (4334204): Missing 'endstream'
-Skipped http://test.portofoakland.com/pdf/boar_shee_040406.pdf: Document exceeded 5000000 bytes
Request for 'http://test.portofoakland.com/pdf/boar_shee_040406.pdf' aborted because: 'too big!'
-Skipped http://test.portofoakland.com/pdf/boar_shee_040302.pdf: Document exceeded 5000000 bytes
Request for 'http://test.portofoakland.com/pdf/boar_shee_040302.pdf' aborted because: 'too big!'
Error (2075520): Missing 'endstream'
-Skipped http://test.portofoakland.com/pdf/boar_shee_040203.pdf: Document exceeded 5000000 bytes
Request for 'http://test.portofoakland.com/pdf/boar_shee_040203.pdf' aborted because: 'too big!'
-Skipped http://test.portofoakland.com/pdf/boar_shee_040120.pdf: Document exceeded 5000000 bytes
Request for 'http://test.portofoakland.com/pdf/boar_shee_040120.pdf' aborted because: 'too big!'
Error (1576446): Missing 'endstream'
Error (2418405): Missing 'endstream'
Error (3605608): Missing 'endstream'
Error (3671122): Missing 'endstream'
Error (3758043): Missing 'endstream'
Error (3850853): Missing 'endstream'
Error (3994443): Missing 'endstream'
Error (4158918): Missing 'endstream'
Error (852832): Missing 'endstream'
Error (1947003): Missing 'endstream'
Error (3640644): Missing 'endstream'
Error (3836274): Missing 'endstream'
Error (464496): Missing 'endstream'
Error (1777249): Missing 'endstream'
Error (2219309): Missing 'endstream'
Error (2401627): Missing 'endstream'
Error (36166): Missing 'endstream'
Error (800619): Missing 'endstream'
Error (1537612): Missing 'endstream'
Error (33117): Missing 'endstream'
Error (33646): Missing 'endstream'
Error (118886): Missing 'endstream'
Error (189354): Missing 'endstream'
Error (618379): Missing 'endstream'
Error (1554531): Missing 'endstream'
Error (1621805): Missing 'endstream'


-- 
Bill Moseley
moseley@hank.org

Unsubscribe from or help with the swish-e list: 
   http://swish-e.org/Discussion/

Help with Swish-e:
   http://swish-e.org/current/docs
   swish-e@sunsite.berkeley.edu