[SOLVED] Forum no longer indexed by Google?

[fredp]

It seems that Google is no longer indexing the domain forum.cmsmadesimple.org. Anyone know if this is by design or by accident?

I used to be able to use Google to search the CMSMS forum with a URL something like this:
https://www.google.com/search?q=site%3A ... .org+print

Now, no matches are found:

Your search - site:forum.cmsmadesimple.org print - did not match any documents.

Searching with Bing, however, still works:
http://www.bing.com/search?q=site%3Afor ... .org+print

[JohnnyB]

Well that explains why I don't get many forum results when searching for cmsmadesimple.org.

I get some results if I leave a space between site: and the URL:
site: http://forum.cmsmadesimple.org + menu

But, the results show that the board has no forums, and in some cases that "you don't have permission to view..."

I don't see anything in the robots.txt stopping it

User-Agent: *
Disallow: /includes
Disallow: /files
Disallow: /docs
Disallow: /cache
Disallow: /stats
Disallow: /index.php/Wike/delete_page
Disallow: /index.php?p=&s=11
Disallow: /index.php?topic=25921.msg%msg_id%

[baresi]

Was wondering the same as I occasionally search, so now I just googled "site:forum.cmsmadesimple.org" with no other terms and it seems google is seeing the forum empty. Notice the up to date cache date but no forums in the screenshot



(original size http://i.imgur.com/KD5aJZT.png)

[KelvinSmith]

I also searched that string in google as well as bing. It doesn't show any result. When, If I removed the "Print" key phrase from given query, it shows following result

https://www.google.com/search?q=site%3A ... simple.org

In this case, Print word not found anywhere in search engine result.

I think this is by accident for forum.cmsmadesimple.org because I tried another some forum sites and it's works perfectly. see the following example. (Remove Spaces After site%3A and /forums/)

https://www.google.com/search?q=site%3A https://www.webhosting.uk.com/forums/ +print

[hoshy]

Googlebot gets the forum displayed with no content.
Therefore it does not index any page.
Just try it by yourself und change the user-agent in your browser.


EDIT:

This affects almost all known search-bots (not only Google).
Only Bingbot, Baiduspider and Google-Web-Preview still get content displayed.

[fredp]

First, thanks to those sharing their comments and observations regarding this issue!

...This affects almost all known search-bots (not only Google).
Only Bingbot, Baiduspider and Google-Web-Preview still get content displayed.

I wonder why this list of bots is permitted access and Google and the others are not. Who would know if there was a problem with the Google (and other) search-bots that caused someone to withhold forum content from them?

[jarrodlsb]

I try to search using google.com.my and I manage to search site:forum.cmsmadesimple.org

[fredp]

I try to search using google.com.my and I manage to search site:forum.cmsmadesimple.org

Indeed, it looks like someone may have fixed this! I just tried google.com again and this time some results were returned. It'll take a while to reindex the entire forum site. I try back in a while and mark this topic SOLVED, once everything looks like it is back in the index.

Thanks!

[velden]

Some actions have been taken to fix the indexing by search engines.

Thanks for posting this issue!