HTTrack/wget enters infinite loop

For questions and problems with the CMS core. This board is NOT for any 3rd party modules, addons, PHP scripts or anything NOT distributed with the CMS made simple package itself.
Post Reply
hakki_dogusan
Forum Members
Forum Members
Posts: 24
Joined: Wed Oct 18, 2006 10:47 am

HTTrack/wget enters infinite loop

Post by hakki_dogusan »

Hi,

(linux host, cmsms-1.2)

I tried to mirror my site (www.dogusan.net) for offline browsing.
HTTrack was creating ~700 files with cmsms-1.1, but now it never finishing.

Is there any change to that effect?

edit-1: I tried with ads disabled; didn't helped.
edit-2: wamp, 1.2 clean install, wget fetches 352 files! 242 of them for news detail?!

--
Regards,
Hakki Dogusan
Last edited by hakki_dogusan on Sat Oct 27, 2007 1:48 pm, edited 1 time in total.
Top
Pierre M.

Re: HTTrack/wget enters infinite loop

Post by Pierre M. »

Hello,

how many pages do you have ? how many news ?
What about setting pretty URLs on ?
HTTrack and wget both have limits to prevent infinite recursion and external fetching.

Pierre M.
Top
hakki_dogusan
Forum Members
Forum Members
Posts: 24
Joined: Wed Oct 18, 2006 10:47 am

Re: HTTrack/wget enters infinite loop

Post by hakki_dogusan »

Hi,

(Thanks for answering.)
Pierre M. wrote: Hello,

how many pages do you have ? how many news ?
What about setting pretty URLs on ?
HTTrack and wget both have limits to prevent infinite recursion and external fetching.

Pierre M.

I did a fresh install of wamp, cmsms-1.2. I didn't add any pages or news.
The numbers mentioned at edit-2 were for wget (wget -w1 -m -k -E http://localhost/).
HTTrack was at 1200 pages when I stop it.


edit: I repeated my test with fresh install of wamp, cmsms-1.1;
      wget: 117 files (+1 for install directory)
      httrack: 116 files
   

--
Regards,
Hakki Dogusan
Last edited by hakki_dogusan on Sat Oct 27, 2007 4:25 pm, edited 1 time in total.
Top
hakki_dogusan
Forum Members
Forum Members
Posts: 24
Joined: Wed Oct 18, 2006 10:47 am

Re: HTTrack/wget enters infinite loop

Post by hakki_dogusan »

Hi,


Do you have any workaround, etc. to this problem? Is downgrading to 1.1 logical? Or changing news module with 1.1's?
I need to prepare a cd having my site for offline browsing...



--
Regards,
Hakki Dogusan
Top
hakki_dogusan
Forum Members
Forum Members
Posts: 24
Joined: Wed Oct 18, 2006 10:47 am

Re: HTTrack/wget enters infinite loop

Post by hakki_dogusan »

Hi,


Is there any changes in 1.2.2 to solve my problem  ::) Just curious..


--
Regards,
Hakki Dogusan
Top
Pierre M.

Re: HTTrack/wget enters infinite loop

Post by Pierre M. »

Hello again,
hakki_dogusan wrote: Is there any changes in 1.2.2 to solve my problem
You should run nothing but the latest official stable release. 1.2.2 today.
If you have a problem with 1.2.2, please report it (see the sticky thread about bug reporting).

Pierre M.
Top
cubix
Power Poster
Power Poster
Posts: 314
Joined: Mon Jul 09, 2007 10:00 am

Re: HTTrack/wget enters infinite loop

Post by cubix »

I need to prepare a cd having my site for offline browsing...
http://forum.cmsmadesimple.org/index.ph ... l#msg87309

or

http://dev.cmsmadesimple.org/projects/htmlexport/

may help?
Top
hakki_dogusan
Forum Members
Forum Members
Posts: 24
Joined: Wed Oct 18, 2006 10:47 am

Re: HTTrack/wget enters infinite loop

Post by hakki_dogusan »

Hi,

Thanks for reply.
Pierre M. wrote: Hello again,
hakki_dogusan wrote: Is there any changes in 1.2.2 to solve my problem
You should run nothing but the latest official stable release. 1.2.2 today.
If you have a problem with 1.2.2, please report it (see the sticky thread about bug reporting).

Pierre M.

I've upgraded my site to 1.2.2.

Didn't test with my site, but tested with a local setup (with recently announced UniformServer with cms-1.2.2, without any change). Reported problem continues.. If news module disabled then problem goes. I can't say that is a bug, though. It may not be related to news module, I don't know...

--
Regards,
Hakki Dogusan
Top
Pierre M.

Re: HTTrack/wget enters infinite loop

Post by Pierre M. »

Hello again,
hakki_dogusan wrote: I've upgraded my site to 1.2.2.
Well done.
hakki_dogusan wrote: recently announced UniformServer
I don't know what you are writing about.
hakki_dogusan wrote: If news module disabled then problem goes.
OK, thank you for this report. You have narrowed the problem so it is half solved.
Please have a look at you news related pages : news lists, summary displays, detailpages, RSS button... the recursion must come from some strange URL scheme.

Pierre M.
Top
hakki_dogusan
Forum Members
Forum Members
Posts: 24
Joined: Wed Oct 18, 2006 10:47 am

Re: HTTrack/wget enters infinite loop

Post by hakki_dogusan »

Hi,
Pierre M. wrote: Hello again,
hakki_dogusan wrote: I've upgraded my site to 1.2.2.
Well done.
hakki_dogusan wrote: recently announced UniformServer
I don't know what you are writing about.
You may see it there:
To isolate problem, instead of trying with my real installation, I tested against a default 1.2.2 installation. Using mentioned UniformServer with 1.2.2 made this easy. You may see that I've did similar tests with default installations before.
Pierre M. wrote:
hakki_dogusan wrote: If news module disabled then problem goes.
OK, thank you for this report. You have narrowed the problem so it is half solved.
Please have a look at you news related pages : news lists, summary displays, detailpages, RSS button... the recursion must come from some strange URL scheme.

Pierre M.

But this requires some knowledge about what is going inside, and ability to dechiper it, which I don't have  :( Let me say differently, If I didn't find CMS-MS I would not have a real web site :) You can see and have fun with my web-abilities at http://www.dynaset.org/dogusanh/  :)

Thanks for your interest, appreciated..

--
Regards,
Hakki Dogusan
Top
Post Reply

Return to “CMSMS Core”