What to include and exclude using robots.txt

[zpeedofdark]

Hello,

I'm wondering if anyone can help me with using robots.txt and cmsms. I have never used it with a CMS before. I assume we don't want the entire site crawled by search engines, only the pages that are relevant. Does anyone have a sort of "default" set of instructions for robot.txt?

Thanks,
Adam

[paulbaker]

See the example robots.txt in the doc folder of the install file structure.

[zpeedofdark]

Thank you. I moved a copy of this file to my root.

[paulbaker]

You're both welcome. This forum is an excellent way to learn about CMSMS, there are plenty of helpful people here who know a lot more about it than me.