>From: Jason L Tibbitts III <tibbs@hpc.uh.edu>
>Basically, I received a complaint that because I make the sum total of my
>list archives available on the web, it is impossible to search for useful
>information because my archive pages keep popping up.
I must admit that I find such things rather frustrating when searching;
wading through 500 hits from a single site is something of a waste, es-
pecially when they're actually intertwined as a discussion thread.
>Yes, I know about robot exclusion, but why should I have to?
Excluding the actual archives would be a Nice Thing, for one simple
reason - searchers would see a link to your "top-level" page, but not
each and every message that registered as a hit. Were I providing a
Web-based archive, I'd advertise the "search the archives" page, but
nothing else.
--Wes
Follow-Ups:
|
|