On Fri, 24 Jan 2003, Smith, Doug wrote:

> I've spend several frustrating hours debugging an index job that uses
> spider.pl, and having found the solution, I thought I'd share it to
> save others the trouble.  I have a site of about 1,000 links, mostly
> HTML and PDF files.  I used the built-in spider.conf and the filter as
> recommended in the docs.  (swish-e 2.2.3, RedHat 8.0 - 2.4.18.)  It
> worked wonderfully on the development server, then failed on the new
> production server (of course).  The spider process failed on several
> of the PDF files, with a message "err: External program failed to
> return required headers Path-Name: & Content-Length:".

That noramlly means that the content-length of the previous "file" sent to
swish was not correct.

> I took one of the offending PDFs and ran it through pdf2html.pm.  
> That failed too, on a "tr / ..." line 201.  After much hunting I
> discovered that the LANG environment variable on the production server
> was "en_US.UTF-8", while the dev server was simply "en_US".  When I
> removed the "UTF-8" from the production box, it worked great!  So, it
> appears that pdf2html.pm wants to do its transliteration in Unicode
> rather than UTF-8, at least, that's my uneducated guess.

So what was happening?  When you say "fail" did Perl give an error
message?





-- 
Bill Moseley moseley@hank.org