[analog-help] Identifying Known Spiders?

Michael Crawford mdcrawford at gmail.com
Thu Jul 3 00:48:16 PDT 2008


I'd like to know the success of my efforts to submit a new site to all
the search engines; some spiders won't visit a site until it's been
online for a while, and some will only visit the home page.

I can see some of the spiders in the BROWSERREP and BROWSERSUM, but
it's missing some because it's definitely missing Googlebot and Yahoo
Slurp.

Also the BROWSERREP shows all the browsers used by my human visitors;
it will get hard to spot spiders when my traffic picks up.

Is there a report specifically for known spiders?

Thanks! -- Mike
-- 
Michael David Crawford
mdcrawford at gmail dot com

 Enjoy my art, photography, music and writing at
http://www.geometricvisions.com/
 --- Free Music Downloads ---


More information about the analog-help mailing list