Skip to main content.
home | support | download

Back to List Archive

Re: Again: Indexing laaarge ammounts of data (more

From: Bill Moseley <moseley(at)not-real.hank.org>
Date: Thu Sep 25 2003 - 01:29:46 GMT
On Wed, Sep 24, 2003 at 05:54:50PM -0700, Hup Chen wrote:

>   I was trying to merge a 1.9GB index1 with a 800MB index2 under my Linux
> ext3 with LFS support, but it failed at "writing word hash", and left me a
> 2.6GB prop.temp.  Seem like it was some kind of overflow.
> 
> 
> Writing index entries ...
>   Writing word text: Complete
>   Writing word hash: ...err: Ran out of memory (could not allocate
> 99880956 more bytes)!

Likely.  



> > While you are in there you could convert to UTF-8, too.
> 
> Sorry if this is a stupid question, how to convert it to UTF-8?

Swish-e only works with 8 bit characters.


-- 
Bill Moseley
moseley@hank.org
Received on Thu Sep 25 01:29:52 2003