Skip to main content.
home | support | download

Back to List Archive

RE: memory problem

From: Bill Moseley <moseley(at)not-real.hank.org>
Date: Tue Sep 16 2003 - 17:23:10 GMT
Sergey,

Can you give an idea of how many indexes you are trying to merge, how
many files are in each index -- and perhap the index sizes?

Were all the indexes *created* with pr3?  I belive there was a change in 
the index format from pr1 to pr2.


On Tue, Sep 16, 2003 at 08:55:35AM -0700, Sergey Vasilevsky wrote:
> I run swish pr3 for merge in debug mode:
> 
> Writing main index...
> Sorting words ...
> Sorting 5160065 words alphabetically
> Writing header ...
> Writing index entries ...
>   Writing word text: Complete
>   Writing word hash: Complete
>   Writing word data: ...
> Breakpoint 1, progerr (msgfmt=0x281a2d40 "Ran out of memory (could not
> allocate %lu more bytes)!") at error.c:59
> 59        if ( !error_handle )
> (gdb) bt
> #0  progerr (msgfmt=0x281a2d40 "Ran out of memory (could not allocate %lu
> more bytes)!") at error.c:59
> #1  0x28192066 in emalloc (size=262144) at mem.c:81
> #2  0x28192111 in allocChunk (size=262144) at mem.c:566
> #3  0x281921dc in Mem_ZoneAlloc (head=0x9b22740, size=115382) at mem.c:616
> #4  0x8057d40 in unSwapLocData (sw=0xa328000, idx_swap_file=6, ep=0x0) at
> index.c:2903
> #5  0x8056a88 in write_index (sw=0xa328000, indexf=0xad95000) at
> index.c:2026
> #6  0x804d35f in write_index_file (sw=0xa328000, process_stopwords=0,
> elapsedStart=1063693296.880335, cpuStart=0, merge=1) at swish.c:1629
> #7  0x804cf9d in cmd_merge (sw_input=0x80c4000, params=0x8150040) at
> swish.c:1418
> #8  0x804b852 in main (argc=36, argv=0xbfbff834) at swish.c:204
> #9  0x804b75d in _start ()
> (gdb) q
> 

-- 
Bill Moseley
moseley@hank.org
Received on Tue Sep 16 17:23:41 2003