Skip to main content.
home | support | download

Back to List Archive

Re: Again: Indexing laaarge ammounts of data (more

From: Bill Moseley <moseley(at)>
Date: Thu Sep 25 2003 - 01:29:46 GMT
On Wed, Sep 24, 2003 at 05:54:50PM -0700, Hup Chen wrote:

>   I was trying to merge a 1.9GB index1 with a 800MB index2 under my Linux
> ext3 with LFS support, but it failed at "writing word hash", and left me a
> 2.6GB prop.temp.  Seem like it was some kind of overflow.
> Writing index entries ...
>   Writing word text: Complete
>   Writing word hash: ...err: Ran out of memory (could not allocate
> 99880956 more bytes)!


> > While you are in there you could convert to UTF-8, too.
> Sorry if this is a stupid question, how to convert it to UTF-8?

Swish-e only works with 8 bit characters.

Bill Moseley
Received on Thu Sep 25 01:29:52 2003