CMS Made Simple Forums

Hello,

When I check my visitorstats in my CMS website I'am noticing that googlebot visites my site alot.

How is this possible or why do they come by so often?

Kind regards, Frans

A visitor from crawl-66-249-71-112.googlebot.com (66.249.71.112) came on 2009-01-23 21:10:29. The browser was Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
This visitor first arrived without a referring URL
and visited /index.php?cntnt01searchinput=books&mact=Search%2Ccntnt01%2Cdos
A visitor from crawl-66-249-71-114.googlebot.com (66.249.71.114) came on 2009-01-23 21:27:41. The browser was Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
This visitor first arrived without a referring URL
and visited /index.php?cntnt01searchinput=collection&mact=Search%2Ccntn
7 minutes 43 seconds later, arrived without a referring URL,
and visited /index.php?amp;mact=Search%2Ccntnt01%2Cdosearch%2C0&cntnt01
A visitor from crawl-66-249-71-113.googlebot.com (66.249.71.113) came on 2009-01-23 21:50:58. The browser was Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
This visitor first arrived without a referring URL
and visited /index.php?cntnt01searchinput=next&
48 minutes 0 seconds later, arrived without a referring URL,
and visited /index.php?cntnt01searchinput=computer&mact=Search%2Ccntnt01%2Cdosearch%2C0

http://www.google.com/webmasters/ - register your page here and set how fast googlebot will index your pages.

Yes, google craws your site. visitorstats shoul be filtering all robots.

Use google analytics instead, detailed information about robots is crap

Regards,

G

I've tried to install GoogleAnalytics but I can't get it to work, it seems.

Ill try this weekend again to re-install the script data...

Thanks for the tips.

Frans

Hello,

fdingen wrote: and visited /index.php?cntnt01searchinput=...

couldn't some robots.txt prevent the crawlers to bug the {search} ?

Pierre M.

Googlebot visiting your site is a good thing   (If you want to be listed in the search engines that is).  (a lot of people complain that Google doesn't index fast enough).  If you want to stop him/her/it, just use robots.txt, or to prevent certain parts of your site from being indexed.

P.S.  The higher your pagerank, the faster and more often Google will visit.  You can tell it to slow down in the Webmasters center of Google.

Take care.