On Wed, Mar 23, 2005 at 10:28:38AM -0800, Carmelo Carchedi wrote:
> I have a tipical xml file like this in utf-8:
> 
> maybe the problem is "accented characters".
> If I have accented characters in <testomassima> tag, i cannot find
> any word (with or without accent) in the xml file.
> 
> Why? 
> is correct to index utf8 files?

It's fine.  In fact all documents parsed by libxml2 are in utf8
internally and then converted to 8-bit encoding (namely 8859-1) at
indexing time.

The trick to debugging is index a single file:

   swish-e -i test.xml -c swish.config -T indexed_words

That -T indexed_words option will have swish display all the words
that are indexed.  Those are the words that you can search for.  Make
sure that the entire document is being indexed -- there are cases
where bad XML will make libxml2 abort processing in the middle of a
document.

Then when searching do:

   swish-e -w foo -H9 | grep Parsed

and that will show you the word(s) swish is searching for in the
index.

The other thing is set ParserWarnLevel 9 in your config file so that
libxml2 will report any errors in processing.


> it's better to convert utf-8 file in other charset?

Doesn't matter.

-- 
Bill Moseley
moseley@hank.org

Unsubscribe from or help with the swish-e list: 
   http://swish-e.org/Discussion/

Help with Swish-e:
   http://swish-e.org/current/docs
   swish-e@sunsite.berkeley.edu