InvalidToken

errorCode int errorCode [@property getter]: returns error code if it's invalid token (can be returned in error tolerant mode of tokenizer)
errorCode int errorCode [@property setter]: sets error code
errorMessage string errorMessage [@property getter]: returns error message if it's invalid token (can be returned in error tolerant mode of tokenizer)
errorMessage string errorMessage [@property setter]: sets error message
invalidTokenType TokenType invalidTokenType [@property getter]: returns type of token parsing of which has been failed - if it's invalid token (can be returned in error tolerant mode of tokenizer)
invalidTokenType TokenType invalidTokenType [@property setter]: sets type of token parsing of which has been failed
text dstring text [@property getter]: text of invalid token
text dchar[] text [@property setter]: text of invalid token
toString string toString [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.

Variables

_errorCode int _errorCode;: Undocumented in source.
_errorMessage string _errorMessage;: Undocumented in source.
_invalidTokenType TokenType _invalidTokenType;: Undocumented in source.
_text dstring _text;: Undocumented in source.

Inherited Members

From Token

_file SourceFile _file;: Undocumented in source.
_line int _line;: Undocumented in source.
_pos int _pos;: Undocumented in source.
_type TokenType _type;: Undocumented in source.
type TokenType type [@property getter]: returns token type
filename SourceFile filename [@property getter]: returns file info for source
line int line [@property getter]: returns 1-based source line number of token start
pos int pos [@property getter]: returns 1-based source line position of token start
text dstring text [@property getter]: returns token text
literalType dchar literalType [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
intValue ulong intValue [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
isUnsigned bool isUnsigned [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
isLong ulong isLong [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
realValue real realValue [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
doubleValue double doubleValue [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
floatValue float floatValue [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
precision byte precision [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
isImaginary bool isImaginary [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
isBracket bool isBracket [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
isOpenBracket bool isOpenBracket [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
isCloseBracket bool isCloseBracket [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
isEof bool isEof [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.
opCode OpCode opCode [@property getter]: returns opcode ID - for opcode tokens
keyword Keyword keyword [@property getter]: returns keyword ID - for keyword tokens
isDocumentationComment bool isDocumentationComment [@property getter]: returns true if this is documentation comment token
isMultilineComment bool isMultilineComment [@property getter]: returns true if this is multiline
isError bool isError [@property getter]: returns true if it's invalid token (can be returned in error tolerant mode of tokenizer)
errorMessage string errorMessage [@property getter]: returns error message if it's invalid token (can be returned in error tolerant mode of tokenizer)
errorCode int errorCode [@property getter]: returns error code if it's invalid token (can be returned in error tolerant mode of tokenizer)
invalidTokenType TokenType invalidTokenType [@property getter]: returns type of token parsing of which has been failed - if it's invalid token (can be returned in error tolerant mode of tokenizer)
setPos void setPos(SourceFile file, int line, int pos): set start position for token (line is 1-based, pos is 0-based)
setFile void setFile(SourceFile file): set source file information for token
setPos void setPos(int line, int pos): set start position for token (line is 1-based, pos is 0-based)
clone Token clone(): Undocumented in source.
toString string toString [@property getter]: Undocumented in source. Be warned that the author may not have intended to support it.