Hello,
When I check my visitorstats in my CMS website I'am noticing that googlebot visites my site alot.
How is this possible or why do they come by so often?
Kind regards, Frans
A visitor from crawl-66-249-71-112.googlebot.com (66.249.71.112) came on 2009-01-23 21:10:29. The browser was Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
This visitor first arrived without a referring URL
and visited /index.php?cntnt01searchinput=books&mact=Search%2Ccntnt01%2Cdos
A visitor from crawl-66-249-71-114.googlebot.com (66.249.71.114) came on 2009-01-23 21:27:41. The browser was Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
This visitor first arrived without a referring URL
and visited /index.php?cntnt01searchinput=collection&mact=Search%2Ccntn
7 minutes 43 seconds later, arrived without a referring URL,
and visited /index.php?amp;mact=Search%2Ccntnt01%2Cdosearch%2C0&cntnt01
A visitor from crawl-66-249-71-113.googlebot.com (66.249.71.113) came on 2009-01-23 21:50:58. The browser was Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
This visitor first arrived without a referring URL
and visited /index.php?cntnt01searchinput=next&
48 minutes 0 seconds later, arrived without a referring URL,
and visited /index.php?cntnt01searchinput=computer&mact=Search%2Ccntnt01%2Cdosearch%2C0
Googlebot visites my site alot...
Re: Googlebot visites my site alot...
http://www.google.com/webmasters/ - register your page here and set how fast googlebot will index your pages.
[url=http://www.polishwebdesign.pl/]Polish WebDesign Cezary Nowak
Projektowanie stron WWW[/ur]
Projektowanie stron WWW[/ur]
Re: Googlebot visites my site alot...
Yes, google craws your site. visitorstats shoul be filtering all robots.
Use google analytics instead, detailed information about robots is crap
Regards,
G
Use google analytics instead, detailed information about robots is crap
Regards,
G
Re: Googlebot visites my site alot...
I've tried to install GoogleAnalytics but I can't get it to work, it seems.
Ill try this weekend again to re-install the script data...
Thanks for the tips.
Frans
Ill try this weekend again to re-install the script data...
Thanks for the tips.
Frans
Re: Googlebot visites my site alot...
Hello,
Pierre M.
couldn't some robots.txt prevent the crawlers to bug the {search} ?fdingen wrote: and visited /index.php?cntnt01searchinput=...
Pierre M.
Re: Googlebot visites my site alot...
Googlebot visiting your site is a good thing
(If you want to be listed in the search engines that is). (a lot of people complain that Google doesn't index fast enough). If you want to stop him/her/it, just use robots.txt, or to prevent certain parts of your site from being indexed.
P.S. The higher your pagerank, the faster and more often Google will visit. You can tell it to slow down in the Webmasters center of Google.
Take care.

P.S. The higher your pagerank, the faster and more often Google will visit. You can tell it to slow down in the Webmasters center of Google.
Take care.
CMSMS Made