System.Security.Util.Tokenizer Class Reference

Collaboration diagram for System.Security.Util.Tokenizer:

Classes
interface	ITokenReader
class	StreamTokenReader
class	StringMaker

Public Member Functions
void	Recycle ()

Public Attributes
int	LineNo

Package Functions
void	BasicInitialization ()
	Tokenizer (string input)
void	ChangeFormat (global::System.Text.Encoding encoding)
void	GetTokens (TokenizerStream stream, int maxNum, bool endAfterKet)

Private Types
enum	TokenSource {   UnicodeByteArray , UTF8ByteArray , ASCIIByteArray , CharArray ,   String , NestedStrings , Other }

Private Member Functions
string	GetStringToken ()

Private Attributes
int	_inProcessingTag
byte[]	_inBytes
char[]	_inChars
string	_inString
int	_inIndex
int	_inSize
int	_inSavedCharacter
Tokenizer.TokenSource	_inTokenSource
Tokenizer.ITokenReader	_inTokenReader
Tokenizer.StringMaker	_maker
string[]	_searchStrings
string[]	_replaceStrings
int	_inNestedIndex
int	_inNestedSize
string	_inNestedString

Detailed Description

Definition at line 10 of file Tokenizer.cs.

---

The documentation for this class was generated from the following file:

• source/mscorlib/System/Security/Util/Tokenizer.cs