Skip to main content.
home | support | download

Back to List Archive

Re: Why does Swish-E hate my Opteron?

From: Fennec Foxen <fennec(at)not-real.gmail.com>
Date: Fri Sep 10 2004 - 19:01:37 GMT
On Fri, 10 Sep 2004 11:44:48 -0700, Bill Moseley <moseley@hank.org> wrote:
> Anyway, this has been a recurring problem.  If you can ship us a few
> Opteron machines this could likely be fixed quickly.
Does shipping over the SSH secure shell protocol count? I could
actually arrange that. Physical machines, though? Mmm... nope.

> What I think is happening is swish is reading and writing different
> sized elements in error on that platform.
>  You can either set DEBUG_PROP in db_native.c or via flags on the
> ./configure line.  That "should" show you how and (more importantly)
> where properties are written and then check if they are read back from
> the same locations or (as I kind of suspect) off by one or two bytes.
Hmm. This seems to have an effect on the indexing process only, not
the search. Should I be doing something else to show property reads on
search, or will search just never tell me these things? :)

Here is the (one-file) indexing operation output.
---------
Write Prop: file 1  PropIDX 0  (meta 6) seek: 8
data=[uncompressed_len: 0 (2 bytes), prop_data: (24 bytes)]
Write Prop: file 1  PropIDX 2  (meta 8) seek: 34
data=[uncompressed_len: 0 (2 bytes), prop_data: (8 bytes)]
Write Prop: file 1  PropIDX 3  (meta 9) seek: 44
data=[uncompressed_len: 0 (2 bytes), prop_data: (8 bytes)]
Writing seek positions to index for file 1
  PropIDX: 0  data=[seek: 8]  main index location: 802168 for 8 bytes
(one print long)
  PropIDX: 1  data=[seek: 0]  main index location: 802176 for 8 bytes
(one print long)
  PropIDX: 2  data=[seek: 34]  main index location: 802184 for 8 bytes
(one print long)
  PropIDX: 3  data=[seek: 44]  main index location: 802192 for 8 bytes
(one print long)

Removing very common words...
no words removed.
Writing main index...
Sorting words ...
Sorting 1,483 words alphabetically
Writing header ...
Writing index entries ...
  Writing word text: Complete
  Writing word hash: Complete
  Writing word data: Complete
1,483 unique words indexed.
Sorting property: swishdocpath
Fetching seek positions for file 1
 property index table at 802168, this file at 802168
   PropIDX: 0  data[Seek: 8] at seek 802168 read 8 bytes (one readlong)
   PropIDX: 1  data[Seek: 0] at seek 802176 read 8 bytes (one readlong)
   PropIDX: 2  data[Seek: 34] at seek 802184 read 8 bytes (one readlong)
   PropIDX: 3  data[Seek: 44] at seek 802192 read 8 bytes (one readlong)
Fetching filenum: 1 propIDX: 0 at seek: 8
 Fetched uncompressed length of 0 (2 bytes storage), now fetching 24
prop bytes from 10
Fetching filenum: 1 propIDX: 2 at seek: 34
 Fetched uncompressed length of 0 (2 bytes storage), now fetching 8
prop bytes from 36
Fetching filenum: 1 propIDX: 3 at seek: 44
 Fetched uncompressed length of 0 (2 bytes storage), now fetching 8
prop bytes from 46
4 properties sorted.
1 file indexed.  79,656 total bytes.  5,840 total words.
Elapsed time: 00:00:00 CPU time: 00:00:00
Indexing done!
Received on Fri Sep 10 12:02:14 2004