On Sun, Apr 02, 2006 at 09:21:03AM -0700, Eric Lease Morgan wrote:
> There is *a lot* of disk I/O going on. It pains me to listen to it.
> What is swish-e doing and when might it be done?
Swish has to keep track of what words it has seen and in what
document and in which position. Without -e that happens in memory,
but uses quite a bit of memory. And if you run out of ram you are
sunk. Moving it to disk saves the ram at the cost of the disk
accesses. Jose designed the -e feature, so he might be able to offer
more details. I think he's too busy these days to monitor this list.
An algorithm redesign is probably what's needed to improve this much.
--
Bill Moseley
moseley@hank.org
Unsubscribe from or help with the swish-e list:
http://swish-e.org/Discussion/
Help with Swish-e:
http://swish-e.org/current/docs
swish-e@sunsite.berkeley.edu
Received on Sun Apr 2 09:52:22 2006