On Jul 11, 2008, at 1:13 PM, Bill Moseley wrote:
>>> makes it hard for browsers to do any caching.
>> It does. If the browser submits a cookie then it uses them. If the
>> browser doesn't submit a cookie then it adds query strings to track
>> the browser. Since spider ignores the cookies, it gets the query
>> strings added.
> You can enable cookies with the spider.
I'm not sure it will solve the problem, as I learn more about the
Can we focus on how to configure spider to ignore arguments for one
site? (each site has a unique configuration file)
Net Consonance : consonant endings by net philanthropy, open source
and other randomness
Users mailing list
Received on Fri Jul 11 16:57:32 2008