Class: Tokenizer

[line 94]
Tokenizer provides an saf.Parser-like wrapper around the PHP tokenizer extension that can be extended for token analysis and parser writing.

One of its uses in Sitellite is parsing PHP code for I18n text by the saf.I18n.Builder package.

Note: Requires the PHP tokenizer extension, which is built into PHP by default as of 4.3.0.

1     <?php
2     
3      class ClassFinder extends Tokenizer {
4          var $classes = array ();
5          var $next = false;
6     
7          function ClassFinder () {
8              $this->addCallback ('_class', T_CLASS);
9              $this->addCallback ('_string', T_STRING);
10         }
11    
12         function find ($code) {
13             if ($this->parse ($code)) {
14                 return $this->classes;
15             } else {
16                 return false;
17             }
18         }
19    
20         function _class ($token, $data) {
21             $this->next = true;
22         }
23    
24         function _string ($token, $data) {
25             if ($this->next) {
26                 $this->classes[] = $token;
27                 $this->next = false;
28             }
29         }
30     }
31    
32     $finder = new ClassFinder ();
33     $res = $finder->find ('<?php
34     	class Foo {
35     		var $foo = "Hello";
36     	}
37     	class Bar {
38     		var $bar = "World";
39     	}
40     ');
41    
42     if (is_array ($res)) {
43         foreach ($res as $class) {
44             echo $class . "<br />\n";
45         }
46     }
47    
48     ?>

Tags:

$code =

[line 104]

Stores the code that is passed to the previous call to parse().

Tags:

$error =

[line 120]

Contains the message if an error occurs.

Tags:

$tokens =

[line 112]

Stores the tokens from the previous call to parse()

Tags:

---

method addCallback [line 193]

---

method normalize [line 133]

---

method parse [line 158]

---

method _default [line 213]