"Michael J. Giarlo" wrote:
> I'm replying personally, because I think the content here is getting more
> and more specific and less and less relevant...

So when the next person has a similiar question, it's not in the archive
and someone (most likely me) has to do this all again.  Please keep the
discussion on the list.

> Anyhoo, the site I'm not indexing isn't my own site.  So I don't see how a
> robots.txt file will tell my indexer to exclude .cgi files.  

You can't for now.  Although swish will only follow <A> tags.  Just out
of curiosity, if a site thought it would be helpful to have a link (not
a form) to a CGI, why do you not want to follow it?

> (I don't know
> much about the robots.txt file, myself, but my impression of it is that
> it's supposed to instruct indexers/spiders/etc. what to index and what not to.)

Exactly, and swish is acting as a spider.

moo
------------------------------------------------------------
           Ron Samuel Klatchko - Software Jester
            Brightmail Inc - rsk@brightmail.com