Am Wed, 31 Jul 2002 schrieben Sie:
> At 12:52 PM 07/31/02 -0700, Khalid Shukri wrote:
> >> Luckily, you are running linux so you can use lsof to see what files the
> >> process is indeed holding open.
> >
> >Seem to be mostly TCP sockets. However, I reach a peak of about 17000 open
> >handles. Wonder what's happening there!
> 
> What state are they in?  What does netstat show?  

 As far as I remember, most where either ESTABLISHED  or CLOSE_WAIT. Gonna have
a closer look at that next time
 > 
> You might also make sure you are using a very current version of LWP -- and
> then try and use the KeepAlive feature, although I think you said you were
> not fetching that many pages from each server.
Yes, i used keepalive and put the keepalive time to 6 minutes. 
I fetched maximal. 3 pages/server

> 
> For your situation using a spider that fetches URLs in parallel might be a
> good thing.
I just started 45 swish-e/spider processes at the same time, which worked
quite well, but if you can recommend a good parallel spider i might try that
the next time. 

> 
> 
> -- 
> Bill Moseley
> mailto:moseley@hank.org

Thanks
khalid

-- 
###############################################################################
#                                                                             # 
# La traditionelle lucidité des dépressifs, souvent décrite comme un          #
# désinvestissement radical à l'égard des préoccupations humaines, se         #
# manifeste en tout premier lieu par un manque d'intérêt pour les questions   #
# effectivement peu intéressantes. Ainsi peut-on, à la rigueur, imaginer un   #
# dépressif amoureux, tandis qu'un dépressif patriote paraît franchement      #
# inconcevable.                                                               #
# (M. Houellebecq: Les particules élémentaires)                               #
#                                                                             #
###############################################################################