Page 1 of 1

CMSMS does not work after adding more than 10000 contents

Posted: Tue Jul 10, 2012 4:22 pm
by bossak
Hello everybody,

I would like to appreciate the work of all the CMSMS team and all the developers giving advices at this board. Since today I have found solutions for all my problems without posting a question.

But now I have the problem that I'm not able to solve by myself and I haven't found any post anywhere (nor google..).

I am developping the system based on CMSMS and everything was great until I imported 10 000 content pages in various categories into the system. With around 2000 everything works well, with 6000 system is slower but with more than 10000 records, after a long time, I am getting this error message:
Fatal error: Maximum execution time of 90 seconds exceeded in /data/web/virtuals/12673/virtual/www/stores/lib/classes/class.cms_route_manager.php on line 127]
The problem is during checking for existing route in the function:

Code: Select all

static public function route_exists(CmsRoute $route)
  {
    if( !is_array(self::$_routes) ) return FALSE;

    foreach( self::$_routes as $test )
      {
	if( $test == $route ) return TRUE;
      }
    return FALSE;
  }
I think that this is not a problem of my hosting server, I tried on my 2x2.6Ghz,4GB RAM server and the result is the same (really long processing...).

My CMSMS Version is 1.10.3.

Please can you give me an advice what to do with so much pages or whether there exists any solution how to allow CMSMS to use more than ~5000 pages?

Thank you very much for your help!

J.M aka Bossak

Re: CMSMS does not work after adding more than 10000 content

Posted: Tue Jul 10, 2012 4:35 pm
by calguy1000
I am sorry to tell you that CMSMS is not designed or intended to run this many content pages.

We have tested CMSMS with a few thousand pages, but we don't test this regularly. This is because when dealing with thousands of content pages the interface should be significantly re-designed and different functionality is required.

Typically when people are trying to build a site with thousands of pages it is because they are importing things like biographies, or product listings etc.

CMSMS content pages cannot be considered to be a 'cck'. If dealing with thousands of records of a specific type you should really use a module that is designed for that type of data.

That said.... the specific problem (wrt routes) that you mentioned should be fixed in CMSMS 1.11. However with 10,000 content pages I would think that you will run into other performance problems and barriers.

Re: CMSMS does not work after adding more than 10000 content

Posted: Tue Jul 10, 2012 5:52 pm
by bossak
Calguy,

thank you very much for your brilliant answer that explained me a lot.

You mentioned some specific modules designed for this purpose that should be used. Would you be as kind as to recommend me some module that can be use to store and to browse content with the following numbers of pages in the structure: 50 pages -> 250 pages -> thousands of pages?
I have tried few and none of those matched my needs.

Thank you again,

Bossak

Re: CMSMS does not work after adding more than 10000 content

Posted: Tue Jul 10, 2012 6:25 pm
by calguy1000
Well, if your content is primarily for E-commerce I would use a module like Products. If you are displaying a catalog of listings, I would use a module like CompanyDirectory. These modules can handle large amounts of data, and are optimized for that type of data.

Re: CMSMS does not work after adding more than 10000 content

Posted: Fri Jul 13, 2012 10:02 am
by bossak
Dear calguy,

thanks for your suggestions. I am trying to rewrite CompDir module to fit my needs...it's a longer way but at the end probably more flexible and functional.

Have a nice day,

bossak