Skip to main content.
home | support | download

Back to List Archive

How many documents can SWISH index?

From: <jmruiz(at)not-real.boe.es>
Date: Mon Jul 17 2000 - 10:47:01 GMT
Hi all,

Swish-e 2.0 uses integers to store all the information:
File numbers, Rank, Positions, etc.
This numbers are stored in a  compressed format in the file
index.

So the theorical limit is 2^31 (signed integer) files, words, ...
The theorical maximum size for a file index is 2 GB.
But this is just theory...

The main limit is your memory!!

All versions of swish-e store all the data in memory while
they are indexing (or merging index files). So you can
easily get an out of memory error if you have lots of 
files and only a few Megs.
Of course, searching has not this problem.

BTW, I have indexed up to 150.000 small files without 
any problem in 2.0. 

cu
Jose
Received on Mon Jul 17 07:04:02 2000