Googlebot visites my site alot...

General project discussion. NOT for help questions.
Post Reply
fdingen
Forum Members
Forum Members
Posts: 25
Joined: Tue Jul 22, 2008 10:11 am

Googlebot visites my site alot...

Post by fdingen »

Hello,

When I check my visitorstats in my CMS website I'am noticing that googlebot visites my site alot.

How is this possible or why do they come by so often?

Kind regards, Frans

A visitor from crawl-66-249-71-112.googlebot.com (66.249.71.112) came on 2009-01-23 21:10:29. The browser was Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
This visitor first arrived without a referring URL
and visited /index.php?cntnt01searchinput=books&mact=Search%2Ccntnt01%2Cdos
A visitor from crawl-66-249-71-114.googlebot.com (66.249.71.114) came on 2009-01-23 21:27:41. The browser was Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
This visitor first arrived without a referring URL
and visited /index.php?cntnt01searchinput=collection&mact=Search%2Ccntn
7 minutes 43 seconds later, arrived without a referring URL,
and visited /index.php?amp;mact=Search%2Ccntnt01%2Cdosearch%2C0&cntnt01
A visitor from crawl-66-249-71-113.googlebot.com (66.249.71.113) came on 2009-01-23 21:50:58. The browser was Mozilla/5.0 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)
This visitor first arrived without a referring URL
and visited /index.php?cntnt01searchinput=next&
48 minutes 0 seconds later, arrived without a referring URL,
and visited /index.php?cntnt01searchinput=computer&mact=Search%2Ccntnt01%2Cdosearch%2C0
User avatar
korpirkor
Forum Members
Forum Members
Posts: 100
Joined: Sun Oct 28, 2007 1:15 pm

Re: Googlebot visites my site alot...

Post by korpirkor »

http://www.google.com/webmasters/ - register your page here and set how fast googlebot will index your pages.
[url=http://www.polishwebdesign.pl/]Polish WebDesign Cezary Nowak
Projektowanie stron WWW[/ur]
viebig

Re: Googlebot visites my site alot...

Post by viebig »

Yes, google craws your site. visitorstats shoul be filtering all robots.

Use google analytics instead, detailed information about robots is crap

Regards,

G
fdingen
Forum Members
Forum Members
Posts: 25
Joined: Tue Jul 22, 2008 10:11 am

Re: Googlebot visites my site alot...

Post by fdingen »

I've tried to install GoogleAnalytics but I can't get it to work, it seems.

Ill try this weekend again to re-install the script data...

Thanks for the tips.

Frans
Pierre M.

Re: Googlebot visites my site alot...

Post by Pierre M. »

Hello,
fdingen wrote: and visited /index.php?cntnt01searchinput=...
couldn't some robots.txt prevent the crawlers to bug the {search} ?

Pierre M.
User avatar
CWebguy
Forum Members
Forum Members
Posts: 139
Joined: Thu Jul 24, 2008 3:31 am

Re: Googlebot visites my site alot...

Post by CWebguy »

Googlebot visiting your site is a good thing ;)  (If you want to be listed in the search engines that is).  (a lot of people complain that Google doesn't index fast enough).  If you want to stop him/her/it, just use robots.txt, or to prevent certain parts of your site from being indexed.

P.S.  The higher your pagerank, the faster and more often Google will visit.  You can tell it to slow down in the Webmasters center of Google.

Take care.
CMSMS Made
Post Reply

Return to “General Discussion”