System.Security.Util.Tokenizer Class Reference

Classes
interface	ITokenReader
class	StreamTokenReader
class	StringMaker

Public Member Functions
void	Recycle ()

Public Attributes
int	LineNo

Package Functions
void	BasicInitialization ()
	Tokenizer (string input)
void	ChangeFormat (Encoding encoding)
void	GetTokens (TokenizerStream stream, int maxNum, bool endAfterKet)

Private Types
enum	TokenSource {   UnicodeByteArray , UTF8ByteArray , ASCIIByteArray , CharArray ,   String , NestedStrings , Other }

Private Member Functions
string	GetStringToken ()

Private Attributes
int	_inProcessingTag
byte[]	_inBytes
char[]	_inChars
string	_inString
int	_inIndex
int	_inSize
int	_inSavedCharacter
Tokenizer.TokenSource	_inTokenSource
Tokenizer.ITokenReader	_inTokenReader
Tokenizer.StringMaker	_maker
string[]	_searchStrings
string[]	_replaceStrings
int	_inNestedIndex
int	_inNestedSize
string	_inNestedString

Detailed Description

Definition at line 8 of file Tokenizer.cs.

---

The documentation for this class was generated from the following file:

• source/mscorlib/System/Security/Util/Tokenizer.cs