CMS Made Simple Forums

So what are you trying to say here Ted? I'm not sure where the bottleneck is coming from. Is it just the number of pages in the database? The size of the pages? The lack of caching?

Russ

Hi Ted,

If it's the size of the database, and this would cause anyone to have to do extra work, then it's probably not worth it as most sites will never reach this size.

However a workaround would be appreciated as I'm busy looking for scripts to convert the pages to html at the moment and with the current 6000+ pages, even that's going to be a big job!

From my tests here, the speed problems seem to be related to the size of contentcache.php.  It's basically a serialized version of the hierarchy of pages.  I use that so we can quickly generate the menus and have access to a page's metadata.

However, unserializing that contentcache back into an object takes some processor resources.  When that content cache is 4 megs (as was my test site w/ 13,000 pages), then it takes a LOT of processor resources to unserialize.  So, as a workaround, I need to figure out a way to not load that cache.  Just turning it off isn't good, because there will be a bunch of SQL calls to grab information for the pages in the menus (though, maybe it's faster at this point).  The only quick fix I can see if caching the whole output to avoid that.

It might be possible to do it as a module, but I might have to add another hook or two to accomplish it.

sioux, I've fixed another one of your sites way back when.  Can you pm me some access information to the site in question?  I want to try a couple of things before I go too crazy trying to write all this caching stuff.

For getting html pages you might want to try HTTrack www.httrack.com. A quote from their website:

"HTTrack is a free (GPL, libre/free software) and easy-to-use offline browser utility.

It allows you to download a World Wide Web site from the Internet to a local directory, building recursively all directories, getting HTML, images, and other files from the server to your computer. HTTrack arranges the original site's relative link-structure. Simply open a page of the "mirrored" website in your browser, and you can browse the site from link to link, as if you were viewing it online. HTTrack can also update an existing mirrored site, and resume interrupted downloads. HTTrack is fully configurable, and has an integrated help system.

WinHTTrack is the Windows 9x/NT/2000/XP release of HTTrack, and WebHTTrack the Linux/Unix/BSD release. See the download page. "

If it can handle your number of pages, well, would be simple to check that out by installing it and running the program on your site.

Hope this helps somewhat.

Thanks very much for pointing that out to me

I'll take a look at it and see if it works for me!

Ted, did you get anywhere with your testing ?