cpp.tokenize.Token Class Reference

List of all members.

Public Member Functions
def	__init__
def	__str__
Public Attributes
	end
	name
	start
	token_type
	whence
Static Private Attributes
	__repr__ = __str__

---

Detailed Description

Data container to represent a C++ token.

Tokens can be identifiers, syntax char(s), constants, or
pre-processor directives.

start contains the index of the first char of the token in the source
end contains the index of the last char of the token in the source

Definition at line 64 of file tokenize.py.

---

Constructor & Destructor Documentation

def cpp.tokenize.Token.__init__	(		self,
			token_type,
			name,
			start,
			end
	)

Definition at line 74 of file tokenize.py.

---

Member Function Documentation

def cpp.tokenize.Token.__str__

(

self

)

Definition at line 81 of file tokenize.py.

---

Member Data Documentation

cpp::tokenize.Token::__repr__ = __str__ [static, private]

Definition at line 86 of file tokenize.py.

cpp::tokenize.Token::end

Definition at line 74 of file tokenize.py.

cpp::tokenize.Token::name

Definition at line 74 of file tokenize.py.

cpp::tokenize.Token::start

Definition at line 74 of file tokenize.py.

cpp::tokenize.Token::token_type

Definition at line 74 of file tokenize.py.

cpp::tokenize.Token::whence

Definition at line 74 of file tokenize.py.

---

The documentation for this class was generated from the following file:

• tokenize.py