Skip to main content.
home | support | download

Back to List Archive

Re: Geting "status: 500" while indexing some pages

From: Juan Carlos Avila / MTBASE <javila(at)not-real.mtbase.com>
Date: Wed Feb 02 2005 - 22:22:27 GMT
Well, ok... I'll try to review the Servlet code to see if this is 
causing the problem (perhaps I'll try using JSPs instead of Servlets), 
although the strange thing is that the *same* Servlet some times gets 
indexed and some times it does not. The code at the end of the Servlet 
is passed to a database engine to retrieve some data and construct the 
final html sent to the browser.

For example:

  http://192.9.202.1/casos/VerCasoIdx?caso_numero=6897 and
  http://192.9.202.1/casos/VerCasoIdx?caso_numero=6896

both produce a slightly different content -- although the basic structure of the html page remains the same. The first URL gets indexed, but the second doesn't.

The *really* odd thing is the both pages are viewed fine from my browser (IE or Firefox).

I'm not very familiar with the tools you mention (netcat, ngrep, tcpdump or ethereal), but I'll do some research, and I'll let you know about my findings.

Thanks a lot for your help! At least I learned today something more about debugging with spider.pl...

Juan


Bill Moseley wrote:

>On Wed, Feb 02, 2005 at 04:34:11PM -0500, Juan Carlos Avila / MTBASE wrote:
>
>  
>
>>I get the following output -- note the message "500 Chunked must be last 
>>Transfer-Encoding 'chunked '" at the end. Also note that if I try to run 
>>the spider just by changing the number at the end of tru URL (ie. 
>>caso_numero=6897), it works fine!
>>    
>>
>
>That's odd.  What does the number have to do with the request????
>
>
>  
>
>>spider.pl: Reading parameters from 'default'
>>-- Starting to spider: 
>>http://192.9.202.1/casos/VerCasoIdx?caso_numero=6896 --
>>vvvvvvvvvvvvvvvv HEADERS for 
>>http://192.9.202.1/casos/VerCasoIdx?caso_numero=6896 vvvvvvvvvvvvvvvvvvvvv
>>    
>>
>
>So, what's the difference between these two requests?  One is a HEAD
>and the other is a GET, but same URL, right?  Sounds like a problem
>with your servlet programmers....
>
>
>  
>
>>---- Request ------
>>HEAD http://192.9.202.1/casos/VerCasoIdx?caso_numero=6896
>>Accept-Encoding: gzip; deflate
>>From: swish@user.failed.to.set.email.invalid
>>User-Agent: swish-e spider 2.2 http://swish-e.org/
>>---- Response ---
>>Status: 200 OK
>>Connection: Close
>>Server: Jaguar Server Version 4.2
>>Content-Length: 8192
>>Content-Type: text/html
>>Client-Date: Wed, 02 Feb 2005 21:28:50 GMT
>>Client-Peer: 192.9.202.1:80
>>Client-Response-Num: 2
>>^^^^^^^^^^^^^^^ END HEADERS ^^^^^^^^^^^^^^^^^^^^^^^^^^
>>vvvvvvvvvvvvvvvv HEADERS for 
>>http://192.9.202.1/casos/VerCasoIdx?caso_numero=6896 vvvvvvvvvvvvvvvvvvvvv
>>---- Request ------
>>GET http://192.9.202.1/casos/VerCasoIdx?caso_numero=6896
>>Accept-Encoding: gzip; deflate
>>From: swish@user.failed.to.set.email.invalid
>>User-Agent: swish-e spider 2.2 http://swish-e.org/
>>---- Response ---
>>Status: 500 Chunked must be last Transfer-Encoding 'chunked '
>>Content-Type: text/plain
>>Client-Date: Wed, 02 Feb 2005 21:28:50 GMT
>>Client-Warning: Internal response
>>    
>>
>
>
>Now, do you have netcat, ngrep, tcpdump or ethereal? The next step
>would be to look at the actual tcp request to see *exactly* what is
>being sent.  That "Request" is not an exact copy of what's sent to the
>server.
>
>I think LWP does add a Transfer-Encoding header:
>
>In LWP/Protocol/http.pm:
>
>   push(@h, "Transfer-Encoding" => "chunked");
>
>But, again, I'd want to use ethereal to look to see exactly what's
>going over the network.  That would be very interesting to look at.
>Need more input, I guess is my response at this time....
>
>Is your application making a second http request to another server?
>Maybe that's where the error is coming from.
>
>Try wiping your hard disk and installing Linux and Apache and see if
>the problem goes away.  Well, try that as a last resort.
>
>
>
>
>
>
>  
>

---------------------------------------------------------------------------

Ya está disponible Sybase ASE Express Edition para Linux, la única base de
datos comercial de clase empresarial gratuita para desarrollo y producción.
Más información en http://www.mtbase.com/linux/promocion

---------------------------------------------------------------------------

Este mensaje, y cualquier archivo que se adjunte al mismo es confidencial y
podría contener información privilegiada y reservada de MTBASE S.A. y
Sybase, Inc, para el uso exclusivo de su destinatario. Si usted ha recibido
este mensaje por error le solicitamos comedidamente avisarnos, abstenerse
de divulgarlo en cualquier forma, y proceder a borrar su contenido de
inmediato. Los sistemas de MTBASE S.A. son revisados con programas anti-
virus periódicamente, no obstante, el destinatario debe examinar el mensaje,
y MTBASE  S.A. no se hace responsable en ningún caso por daños derivados de
la recepción del presente mensaje.
Received on Wed Feb 2 14:22:28 2005