What is the tokenizer needed for?

[OlafNoehring]

Hi

I am having problems using cmsms on a server - no tokenizer in php.
What is the tokenizer needed / used for in cmsms?
Is there a way to "tunr it off" ?

Olaf

[Ted]

Smarty uses the tokenizer to do bits of parsing...  there is no way to turn that off.  The tokenizer became a stardard piece of PHP starting with 4.3.0 (Release Date: 27-Dec-2002).

Ted