Class: CodeGen_Tools_Tokenizer

Source Location: /CodeGen-1.0.7/CodeGen/Tools/Tokenizer.php

Class Overview

A simple tokenizer for e.g. proto parsing

Author(s):

Hartmut Holzgraefe <hartmut at php.net>

Version:

Release: @package_version@

Copyright:

2005-2008 Hartmut Holzgraefe

Variables

Methods

Inherited Variables

Inherited Methods

Class Details

[line 33]
A simple tokenizer for e.g. proto parsing

Author: Hartmut Holzgraefe <hartmut@php.net>
Version: Release: @package_version@
Copyright: 2005-2008 Hartmut Holzgraefe
Link: http://pear.php.net/package/CodeGen
License: PHP License 3.0

[ Top ]

Class Variables

$done = false

[line 68]

Parsing complete?

Access: public

Type:

bool

[ Top ]

$pos =

[line 47]

Current parsing position

Access: protected

Type:

int

[ Top ]

$string =

[line 40]

String to parse

Access: protected

Type:

string

[ Top ]

$token =

[line 54]

Current token content

Access: public

Type:

string

[ Top ]

$type =

[line 61]

Current token type (name, numeric, string)

Access: public

Type:

string

[ Top ]

Method Detail

__construct (Constructor) [line 82]

CodeGen_Tools_Tokenizer __construct(
string
$string)

Konstruktor

Access: public

Parameters:

string $string — String to parse

[ Top ]

nextToken [line 121]

bool nextToken(
)

Read next token into $this->type, $this->token

Return: success?
Access: public

[ Top ]

pullChar [line 95]

string pullChar(
)

get next character to parse

Access: protected

[ Top ]

pushChar [line 110]

void pushChar(
string
$char)

Push back read character(s)

Access: protected

Parameters:

string $char — characters to pusch back

[ Top ]

pushToken [line 280]

void pushToken(
)

Push back a parsed token

Access: public

[ Top ]