Skip to main content.
home | support | download

Back to List Archive

spider file

From: Rich Thomas <thomasr(at)not-real.buffalo.edu>
Date: Mon Jan 28 2002 - 15:43:44 GMT
Bill,

I can't tell which file is causing it.  here's the output of a -T
INDEX_FILES

# ./swish-e -T INDEX_FILES


-----> FILES in index index.swish-e <-----
Dumping File Properties for File Number: 1
 (No Properties)

ReadAllDocProperties:
          swishdocpath: 6 ( 51) S:
"http://ublin.lib.buffalo.edu/webcat/bibcat/A/A/E/9/"
            swishtitle: 7 ( 31) S: "Index of /webcat/bibcat/A/A/E/9"
          swishdocsize: 8 (  4) N: "0000000114593"
     swishlastmodified: 9 (  4) D: "1969-12-31 19:00:00"
      swishdescription:10 (30158) S: "Index of /webcat/bibcat/A/A/E/9 Name
Last modified Size Description Parent Directory 12-Nov-2001 21:56 - 000.html
20-Nov-2001 14:09 1k 001.html 20-Nov-2001 14:09 1k 002.html 20-Nov-2001
14:09 1k 003.html 20-Nov-2001 14:09 1k 004.html 20-Nov-2001 14:09 1k
005.html 20-Nov-2001 14:09 1k 006.html 20-Nov- ..."

ReadSingleDocPropertiesFromDisk:
          swishdocpath: 6 ( 51) S:
"http://ublin.lib.buffalo.edu/webcat/bibcat/A/A/E/9/"
            swishtitle: 7 ( 31) S: "Index of /webcat/bibcat/A/A/E/9"
          swishdocsize: 8 (  4) N: "0000000114593"
     swishlastmodified: 9 (  4) D: "1969-12-31 19:00:00"
      swishdescription:10 (30158) S: "Index of /webcat/bibcat/A/A/E/9 Name
Last modified Size Description Parent Directory 12-Nov-2001 21:56 - 000.html
20-Nov-2001 14:09 1k 001.html 20-Nov-2001 14:09 1k 002.html 20-Nov-2001
14:09 1k 003.html 20-Nov-2001 14:09 1k 004.html 20-Nov-2001 14:09 1k
005.html 20-Nov-2001 14:09 1k 006.html 20-Nov- ..."
        **Compressed**: 30158 -> 2650 (8.79%)


Number of File Entries: 1

And here's my swish.conf

SwishProgParameters default
http://ublin.lib.buffalo.edu/webcat/bibcat/A/A/E/9
StoreDescription HTML2 <body> 100000
DefaultContents HTML2

Command line:

 ./swish-e -S prog -c swish.conf -i ./spider.pl -v9

Rich




*********************************************************************
Due to deletion of content types excluded from this list by policy,
this multipart message was reduced to a single part, and from there
to a plain text message.
*********************************************************************
Received on Mon Jan 28 15:46:43 2002